Abstract:Regression testing is widely used to check whether software changes lead to test failures. Regression Test Prioriti-zation (RTP) aims to order tests such that tests that are more likely to fail are run earlier. Prior RTP techniques—which we call hierarchy-unaware (HU)—ignored an important aspect: real test suites are organized hierarchically, and individual tests belong to composites that can be hierarchically nested. Prior RTP work overlooked the runtime cost to switch across hierarchical test compositesand used the APFD c metric, which represents the runtime of tests till test failures, to rank orders generated by RTP techniques. However, APFD c can misleadingly rank orders if their runtimes differ (e.g., two orders may have different numbers of composite switches and, consequently, runtimes). To account for runtime differences, we propose a new metric, HAPFD c . Unlike APFD c , HAPFD c enables proper comparison of test orders with different runtimes by "extending" runtimes as needed. To reduce the cost of composite switching, we introduce hierarchy-aware (HA) RTP by presenting meta-techniques that first prioritize composites and then tests within composites. We evaluate HA RTP on test classes in multi-module Java and Maven projects from two large datasets used in prior work. The results show that our HA RTP improves both HAPFD c values and time-based metrics over HU RTP.

A Hierarchical Model for Regression Test Selection and Cost Analysis of Java Programs

AN ECONOMICAL COST-BENEFIT MODEL FOR TEST CASE PRIORITIZATION OF REGRESSION TESTING

An Approach to Regression Test Selection Based on Hierarchical Slicing Technique

A Hierarchical Model for Test-Cost-sensitive Decision Systems

A novel approach to regression test selection for J2EE applications

Select Strategy of Regression Testing on Object-oriented Software

ANALYZE OF FUNCTIONAL REGRESSION TEST TOOLS

Towards Regression Test Selection for AspectJ Programs

A History-Based Cost-Cognizant Test Case Prioritization Technique in Regression Testing

Regression Test Selection for Distributed Java RMI Programs by Means of Formal Concept Analysis

A Test-Suite Rceduction Based on Multi-Objective Decision Making

An Improved Regression Test Selection Technique by Clustering Execution Profiles

Time-Constrained Test Selection For Regression Testing

Study of a software cost model based on testing level

Test Selection with Equivalence Class Partitioning

Efficient Testing Model Based on Pareto Distribution

Regression Test Generation Approach Based on Tree-Structured Analysis

Regression Testing Of Object-Oriented Programs On Class Members Granularity

An Empirical Study on Cluster Test Selection Approaches

Optimal Regression Testing Based on Selective Coverage of Test Requirements

Hierarchy-Aware Regression Test Prioritization