InfoSupport – On the Quality of Quality Models

This report looks into the usability of the SQALE approach at software corporation Info Support BV. This technique enables Info Support to appraise the quality of Java and C# source code. We found that SQALE, as implemented in the Sonar tool, offers a workable solution to perform this quality assessment for projects of both languages.

Contents: InfoSupport – On the Quality of Quality Models

1. Introduction
1.1. Problem Statement
1.2. Goal statement
1.3. Scope
1.4. Research Question
1.4.1. Definitions
1.4.2. Question formulation
1.5. Document Structure
1.6. Related Work
1.7. Conclusion
2. Theoretical Background
2.1. Info Support Context
2.1.1. On Software Engineering and Management at Info Support
2.1.2. Earlier Work at Info Support
2.2. Quality Model Terminology
2.3. On the ISO 25000 standard
2.3.1. The ISO 9126 component
2.3.2. The ISO 14598 component
2.4. On Quality Models
2.4.1. McCal Model
2.4.2. Boehm Model
2.4.3. Dromey Model
2.4.4. SIG model
2.4.5. Qualixo Model
2.4.6. SQALE Model
2.5. Discussion
2.6. On Quality Assessment Tools
2.6.1. Comparison Criteria
2.6.2. Tools
2.6.3. Comparison & Conclusion
2.7. On Financial Indicators for Software Quality
3. Research Design
3.1. Project Subset Selection J.H. Hegeman – Master Thesis – Unrestricted version
3.2. Expert Opinion Phase
3.2.1. Employee selection
3.2.2. Survey Design
3.2.3. Survey Conduction
3.2.4. Survey Conclusions
3.3. Financial Investigation Phase
3.3.1. Financial Indicator Calculations
3.4. Proof of Concept Phase
3.4.1. Proof of Concept Setup
3.4.2. Software Quality Assessment
3.4.3. Assessment Result Analysis
3.5. Research Results Phase
3.5.1. Correlation Calculations
3.5.2. Statistical Significance
3.5.3. Procedure
3.5.4. Calibrating the Quality Model Configuration
4. Validation Data Collection Results: Expert Opinions
4.1. Data Collection Process
4.2. Expert Project Ratings
4.3. Characteristic Correlations
5. Validation Data Collection Results: Financial Indicators
6. Proof of Concept
6.1. SQALE implementation in Sonar
6.1.1. Implementation characteristics
6.1.2. Mapping of SQALE characteristics to quality definition
6.1.3. Relationship with ISO 9126
6.2. Setting up the Proof of Concept
6.2.1. Initial Sonar Setup attempt
6.2.2. Sonar SQALE Quality Model Settings
6.2.3. .Net Project Setup
6.2.4. Initial Quality Model Configuration Calibration & Setup Test
7. Analysis & Optimization
7.1. Validating the Validation data
7.2. Initial Validation Results J.H. Hegeman Master Thesis Unrestricted version 11
7.2.1. Calculating Correlations
7.2.2. Sensitivity
7.2.3. Correlations of Characteristics
7.3. Calibrating the configuration: applying Info Support rule set
7.3.1. Reconfiguring the rule set
7.3.2. Reconfiguring the rule characteristic mapping
7.4. Reflection
7.4.1. What is an optimal configuration?
7.4.2. Why do correlations on characteristic-level remain low?
7.4.3. On the Suitability of Sonar
7.5. SQALE Extension Proposals
7.5.1. Balancing the Ratings
7.5.2. Adding Weights to Rule Violations
8. Recommendations for Info Support
8.1. Do not try this at home
8.2. Keep an eye open for newer and better tools
8.3. Run tools on appropriate hardware
8.4. Integrate analysis in PDC Nightly Builds
8.5. Sell Quality Assessment as a service
8.6. Assign method responsibility and authority
8.7. Improve incident registration procedure
9. Discussion
9.1. What the Method Does Not Do
9.1.1. Functionality Verification
9.1.2. Test Quality
9.1.3. Non-source code components
9.1.4. Process metrics
9.2. On Correlation-limiting factors
9.3. Generalizability of Research Results
9.3.1. Background information and Tool selection
9.3.2. Research Design
9.3.3. Validation Results
9.4. The Remediation Cost Paradigm
9.5. On the Concept of Quality J.H. Hegeman Master Thesis – Unrestricted version 12
10. Future Research
10.1. Benchmark-based calibration
10.2. Lines of Code versus Function Points
11. Conclusion
11.1. Answers to the main Research Questions
11.2. Proof of Concept Setup
11.2.1. Initial Correlations
11.2.2. Optimizing the Configuration
11.3. Obtaining validation data
11.3.1. Expert Opinions
11.3.2. Financial Investigation
11.4. Other Findings
11.4.1. Recommendations for Info Support…

Source: University of Twente

Download URL 2: Visit Now

Leave a Comment