Abstract:Mutation testing, a fundamental software testing technique, which is a typical way to evaluate the adequacy of a test suite. In mutation testing, a set of mutants are generated by seeding the different classes of faults into a program under test. Test data shall be generated in the way that as many mutants can be killed as possible. Thanks to numerous tools to implement mutation testing for different languages, a huge amount of mutants are normally generated even for small-sized programs. However, a large number of mutants not only leads to a high cost of mutation testing, but also make the corresponding test data generation a non-trivial task. In this paper, we make use of intelligent technologies to improve the effectiveness and efficiency of mutation testing from two perspectives. A machine learning technique, namely fuzzy clustering, is applied to categorize mutants into different clusters. Then, a multi-population genetic algorithm via individual sharing is employed to generate test data for killing the mutants in different clusters in parallel when the problem of test data generation as an optimization one. A comprehensive framework, termed as $\mathbf {FUZGENMUT}$ , is thus developed to implement the proposed techniques. The experiments based on nine programs of various sizes show that fuzzy clustering can help to reduce the cost of mutation testing effectively, and that the multi-population genetic algorithm improves the efficiency of test data generation while delivering the high mutant-killing capability. The results clearly indicate that the huge potential of using intelligent technologies to enhance the efficacy and thus the practicality of mutation testing.

Concurrency Bug-Oriented Mutation Operators Design for Java

Mutation Strategy Based on Concurrent Program Data Racing Fault

Predicting concurrency bugs: how many, what kind and where are they?

OWL: Understanding and Detecting Concurrency Attacks

A self-adaptive test framework for concurrent programs

A New Mutation Analysis Method for Testing Java Exception Handling

A Lightweight Program Dependence Based Approach to Concurrent Mutation Analysis

Concurrent Program Semantic Mutation Testing Based on Abstract Memory Model

Mutation Testing of Memory-Related Operators

A Survey on Exposing,Detecting and Avoiding Concurrency Bugs

Fixing, Preventing, and Recovering from Concurrency Bugs

Automatic Debugging of Operator Errors Based on Efficient Mutation Analysis

OBJ-D:An Object-centric Concurrency Bug Detection Framework for Java

ColFinder Collaborative Concurrency Bug Detection

Weak Mutation Testing and Its Transformation for Message Passing Parallel Programs

Concurrency Bug Avoiding Based on Optimized Software Transactional Memory.

Enhancement of Mutation Testing Via Fuzzy Clustering and Multi-Population Genetic Algorithm

MMOS: Multi-Staged Mutation Operator Scheduling for Deep Learning Library Testing

A Study of Equivalent and Stubborn Mutation Operators Using Human Analysis of Equivalence

A Lightweight System for Detecting and Tolerating Concurrency Bugs

Two New Kinds of Class Level Mutants for Object-Oriented Programs.