Abstract:Software testing is one of the most essential parts of the software lifecycle and requires a substantial amount of time and effort. During the software evolution, test cases should co-evolve with the production code. However, the co-evolution of test cases often fails due to tight project schedules and other reasons. Obsolete test cases improve the cost of software maintenance and may fail to reveal faults and even lead to future bugs. Therefore, it is essential to detect and update these obsolete test cases in time. In this paper, we propose a novel approach Ceprot (Co-Evolution of Production-Test Code) to identify outdated test cases and update them automatically according to changes in the production code. Ceprot consists of two stages, i.e., obsolete test identification and updating. Specifically, given a production code change and a corresponding test case, Ceprot first identifies whether the test case should be updated. If the test is identified as obsolete, Ceprot will update it to a new version of test case. To evaluate the effectiveness of the two stages, we construct two datasets. Our dataset focuses on method-level production code changes and updates on their obsolete test cases. The experimental results show that Ceprot can effectively identify obsolete test cases with precision and recall of 98.3% and 90.0%, respectively. In addition, test cases generated by Ceprot are identical to the ground truth for 12.3% of samples that are identified as obsolete by Ceprot. We also conduct dynamic evaluation and human evaluation to measure the effectiveness of the updated test cases by Ceprot. 48.0% of updated test cases can be compiled and the average coverage of updated cases is 34.2% which achieves 89% coverage improvement over the obsolete tests. We believe that this study can motivate the co-evolution of production and test code.

Software Product Line Evolution Driven by Source Code Changes

Identify and Update Test Cases when Production Code Changes: A Transformer-Based Approach

An Architecture-based Evolution Management Method for Software Product Line.

Why is My Code Change Abandoned?

Product Line-Based Software Development

Ast Based Java Software Evolution Analysis

Feature increment oriented approach for software product line analysis

Architecture Evolution in Software Product Line: An Industrial Case Study.

REFERENCE DESIGN METHOD FOR SOFTWARE PRODUCT LINE BASED ON FEATURE DECOMPOSITION PATTERN

Software Product Line Engineering via Software Transplantation

A Survey and Comparison of Industrial and Academic Research on the Evolution of Software Product Lines

Resolving code smells in software product line using refactoring and reverse engineering

Synchronized Architecture Evolution in Software Product Line Using Bidirectional Transformation

Towards Understanding Requirement Evolution in a Software Product Line an Industrial Case Study.

Analyzing Performance-Aware Code Changes in Software Development Process

Visual exploration of software evolution via topic modeling

Detecting Source Code Changes to Maintain the Consistence of Behavioral Model

High-confidence Software Evolution

Optimization of Variability in Software Product Lines

Model-Driven Impact Analysis of Software Product Lines.

Reusable design method of products based on knowledge evolution