Abstract:Context: Software Quality Assurance (SQA) is a fundamental part of software engineering to ensure stakeholders that software products work as expected after release in operation. Machine Learning (ML) has proven to be able to boost SQA activities and contribute to the development of quality software systems. In this context, Causal Reasoning is gaining increasing interest as a methodology to go beyond a purely data-driven approach by exploiting the use of causality for more effective SQA strategies. Objective: Provide a broad and detailed overview of the use of causal reasoning for SQA activities, in order to support researchers to access this research field, identifying room for application, main challenges and research opportunities. Methods: A systematic review of the scientific literature on causal reasoning for SQA. The study has found, classified, and analyzed 86 articles, according to established guidelines for software engineering secondary studies. Results: Results highlight the primary areas within SQA where causal reasoning has been applied, the predominant methodologies used, and the level of maturity of the proposed solutions. Fault localization is the activity where causal reasoning is more exploited, especially in the web services/microservices domain, but other tasks like testing are rapidly gaining popularity. Both causal inference and causal discovery are exploited, with the Pearl's graphical formulation of causality being preferred, likely due to its intuitiveness. Tools to favour their application are appearing at a fast pace - most of them after 2021. Conclusions: The findings show that causal reasoning is a valuable means for SQA tasks with respect to multiple quality attributes, especially during V&V, evolution and maintenance to ensure reliability, while it is not yet fully exploited for phases like ...
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the application of causal reasoning (CR) in software quality assurance (SQA), as well as the challenges and opportunities it brings. Specifically, the paper aims to provide a comprehensive and detailed overview, showing the application of CR in SQA activities, helping researchers better understand this field, and identifying the application space, major challenges, and research opportunities.
### Core issues of the paper:
1. **Application of causal reasoning in SQA**: The paper explores the application of CR in all stages of the software life cycle, including verification and validation (V&V), evolution, and maintenance, etc., to ensure software reliability.
2. **Main methods and techniques**: The paper analyzes the main methods of CR, such as causal inference and causal discovery, and points out that Pearl's graphical causal model is widely adopted because of its intuitiveness.
3. **Tools and support**: The paper mentions that in recent years, many tools supporting the application of CR have emerged, especially developing rapidly after 2021.
4. **Research status and future directions**: The paper summarizes the current research results, points out the value of CR in SQA, and proposes future research directions, especially that the application in the requirements engineering and design stages has not been fully developed.
### Research background:
- **Software quality assurance (SQA)**: SQA is an important part of software engineering, aiming to ensure that software products can run as expected after release. With the development of machine learning (ML), ML has been proven to be able to enhance SQA activities and improve the quality of software systems.
- **Causal reasoning (CR)**: CR is a technique that goes beyond pure data - driven methods, formulating more effective SQA strategies by using causal relationships. CR has been widely applied in multiple fields (such as epidemiology, economics, social sciences, etc.), but its application in software engineering is still in the emerging stage.
### Main conclusions:
- **Application areas**: CR is most widely applied in fault localization, especially in the fields of Web services and microservices. Other tasks such as testing are also gradually attracting attention.
- **Method selection**: Both causal inference and causal discovery are widely used, among which Pearl's graphical causal model is highly favored because of its intuitiveness.
- **Tool development**: In recent years, tools supporting the application of CR have developed rapidly, and most of them have emerged after 2021.
- **Future research directions**: The paper points out that the application of CR in the requirements engineering and design stages still needs to be further explored, providing new opportunities for future SQA research.
Through a systematic review, this paper provides researchers with a comprehensive perspective on the application of CR in SQA and points out the direction for future research.