Abstract:Mutation testing, a mainstream fault-based software testing technique, can mimic a wide variety of software faults by seeding them into the target program and resulting in the so-called mutants. Test data generated in mutation testing should be able to kill as many mutants as possible, hence guaranteeing a high fault-detection effectiveness of testing. Nevertheless, the test data generation can be very expensive, because mutation testing normally involves an extremely large number of mutants and some mutants are hard to kill. It is thus a critical yet challenging job to find an efficient way to generate a small set of test data that are able to kill multiple mutants at the same time as well as reveal those hard-to-detect faults. In this paper, we propose a new approach for test data generation in mutation testing, through the novel applications of the Markov chain usage model and the estimation of distribution algorithm. We first utilize the Markov chain usage model to reduce the so-called mutant branches in weak mutation testing and generate a minimal set of extended paths. Then, we regard the problem of generating test data as the problem of covering extended paths and use an estimation of distribution algorithm based on probability model to solve the problem. Finally, we develop a framework, TAMMEA, to implement the new approach of generating test data for mutation testing. The empirical studies based on fifteen object programs show that TAMMEA can kill more mutants using fewer test data compared with baseline techniques. In addition, the computation overhead of TAMMEA is lower than that of the baseline technique based on the traditional genetic algorithm, and comparable to that of the random method. It is clear that the new approach improves both the effectiveness and efficiency of mutation testing, thus promoting its practicability.

An Approach of Regression Test Case Generation Based on Variable Impact Analysis and Data Mutation

Improving Defect Detection Ability of Derived Test Cases Based on Mutated UML Activity Diagrams

Test Case Generation using Mutation Operators and Fault Classification

An Approach to Test Data Generation for Killing Multiple Mutants

Test Data Generation for Mutation Testing Based on Markov Chain Usage Model and Estimation of Distribution Algorithm

AN AUTOMATIC GENERATION TOOL FOR UNIT TEST CASE BASED ON DYNAMIC SYMBOLIC EXECUTION

Regression Test Cases Generation Based on Automatic Model Revision

Regression Test Generation Approach Based on Tree-Structured Analysis

Automatic Debugging of Operator Errors Based on Efficient Mutation Analysis

An Approach to Generate Software Test Data for a Specific Path Automatically with Genetic Algorithm

Automatic Test Generation for Mutation Testing on Database Applications.

Automatic Test Data Generation Based on Usage Model and Genetic Algorithm

Test Case Generation Based on Program Invariant and Adaptive Random Algorithm

Towards Mutation Analysis for Use Cases

A New Test Case Generation Method Based on Data Flow Graph

Improving Failure Detection by Automatically Generating Test Cases Near the Boundaries.

DiffGen: Automated Unit Test Generation for Regression Testing

Mutation-Based Simulation Test Data Generation for Testing Complex Real-Time Software

Assertion-Directed Test Case Generation

Isomorphic Regression Testing: Executing Uncovered Branches Without Test Augmentation.

A Dynamic Stochastic Model for Automatic Grammar-Based Test Generation