Abstract:Summary Continuous integration, at its core, includes a set of practices that aim to prevent and reduce the cost of software integration issues by merging working software copies often. Regression testing is considered a good practice in software development with continuous integration, which ensures that code changes are not negatively affecting software functionality. As, nowadays, software development is carried out iteratively, with small code increments continuously developed and regression tested, it is of critical importance that continuous regression testing is time efficient. However, in practice, regression testing is often long lasting and faces scalability problems as software grows larger or as software changes are made more frequently. One contributing factor to these issues is test redundancy, which causes the same software functionality being tested multiple times across a test suite. In large‐scale software, especially highly configurable software, redundancy in continuous regression testing can significantly grow the size of test suites and negatively affect the cost effectiveness of continuous integration. This paper presents a practical learning algorithm for optimizing continuous integration testing by reducing ineffective test redundancy in regression suites. The novelty of the algorithm lies in learning and predicting the fault‐detection effectiveness of continuous integration tests using historical test records and combining this information with coverage‐based redundancy metrics. The goal is to identify ineffective redundancy, which is maximally reduced in the resulting regression test suite, thus reducing test time and improving the performance of continuous integration. We apply and evaluate the algorithm in two industrial projects of continuous integration. The results show that the proposed algorithm can improve the efficiency of continuous integration practice in terms of decreasing test execution time by 38% on average compared to the industry practice of our case study and by 40% on average compared to the retest‐all approach. The results further demonstrate no significant reduction in fault‐detection effectiveness of continuous regression testing. This suggests that the proposed algorithm contributes to the state of the practice in the continuous integration development and testing of highly configurable systems.

On combining commit grouping and build skip prediction to reduce redundant continuous integration activity

Unifying Defect Prediction, Categorization, and Repair by Multi-Task Deep Learning

The Why, When, What, and How about Predictive Continuous Integration: A Simulation-Based Investigation

Detecting Continuous Integration Skip : A Reinforcement Learning-based Approach

A Machine Learning Approach to Improve the Detection of CI Skip Commits

Cutting the Software Building Efforts in Continuous Integration by Semi-Supervised Online AUC Optimization.

A learning algorithm for optimizing continuous integration development and testing practice

DevOps Improvements for Reduced Cycle Times with Integrated Test Optimizations for Continuous Integration

Could We Predict the Result of a Continuous Integration Build? An Empirical Study

Poster: Improving Cloud-Based Continuous Integration Environments

Does Using Bazel Help Speed Up Continuous Integration Builds?

ABC: Accelerated Building of C/C++ Projects

Statically Verifying Continuous Integration Configurations

Fail Fast - Fail Often: Enhancing Agile Methodology using Dynamic Regression, Code Bisector and Code Quality in Continuous Integration (CI)

Continuous Integration Theater

AI-Driven Continuous Integration and Continuous Deployment in Software Engineering

Does Socio-Technical Congruence Have an Effect on Continuous Integration Build Failures? An Empirical Study on 10 GitHub Projects

Built to Last or Built Too Fast? Evaluating Prediction Models for Build Times

Uncovering the Benefits and Challenges of Continuous Integration Practices

The impact of a continuous integration service on the delivery time of merged pull requests

Deep Learning Based Continuous Integration and Continuous Delivery Software Defect Prediction with Effective Optimization Strategy