Success Evaluation and Measures in Software Process Improvement

Purpose: Investigate and examine industry practice with regards to evaluation of process improvement, identification of measures and methods for success evaluations. The main reasoning is to use empirical data from industry, data from academia and research as input for suggesting proposals for improvement and discussion new avenues for future research in a field not addressed by e.g. traditional investment theory or marketing research.

Method: Interviews were used and several data sources were elicited to gather empirical data. Literature surveys complemented this. Ultimately a triangulation approach was adopted to gradually and continuously compare and identify the chasms between academia and the reality and needs of industry…


1 Introduction
1.1 Software Processes – The Development Itself
2 Methodology
2.1 Sampling
2.1.1 The Industry Representatives (the Companies)
2.1.2 Selection (Sampling Criteria Discussion)
2.2 Validity Issues
2.2.1 Conclusion Validity
2.2.2 Internal Validity
2.2.3 Construct Validity
2.2.4 External Validity
3 Background and Theory
3.1 Introduction to Software Process Improvement
3.1.1 Inductive Frameworks (QIP)
3.1.2 Prescriptive (Model-based) Frameworks
3.1.3 General SPI – Success Factors
4 Measurability of Software Process Improvement (Data Source A)
4.1 Measuring Success in Model-based Frameworks (Adherence to Model)
4.2 Measuring Success in Inductive Frameworks (GQM)
4.3 Measuring success Industry Examples
5 Investment Appraisal (Data Source B)
5.1 Material and non-Material Investments
5.2 Sunk Costs
5.3 The Payback Method
5.4 Cost of Capital
5.5 Valuation, the Monetary Value of Time
5.6 Costs of Quality
5.7 Costs of Process Improvement
6 Industry Practice – An Empirical Investigation (C)
6.1 Workshops with Value Estimation
6.2 Pilots with Expert Opinion
6.3 Objective Measures (Metrics Collection and Analysis)
6.4 Adherence to Model (Benchmarking Against Best Practices)
6.5 Combinatory Methods
7 Process Evaluation and Measurement Proposal
7.1 Alternative SPI Investments
7.1.1 Example of Investment Calculation for a SPI Alternative (Pre-evaluation)
7.1.2 Example of Post-evaluation Using Expert Opinion
7.1.3 Comparison between Customer Value Analysis and Internal Value Analysis
7.1.4 Discussion of Utilization and Calculation using Baselines and Value Analysis
8 Discussion and Conclusions
9 References

Author: Tony Gorschek, Pär Åsfält

Source: Blekinge Institute of Technology

Reference URL 1: Visit Now

Leave a Comment