Abstract:Search-based test generation is guided by feedback from one or more fitness functions - scoring functions that judge solution optimality. Choosing informative fitness functions is crucial to meeting the goals of a tester. Unfortunately, many goals - such as forcing the class-under-test to throw exceptions, increasing test suite diversity, and attaining Strong Mutation Coverage - do not have effective fitness function formulations. We propose that meeting such goals requires treating fitness function identification as a secondary optimization step. An adaptive algorithm that can vary the selection of fitness functions could adjust its selection throughout the generation process to maximize goal attainment, based on the current population of test suites. To test this hypothesis, we have implemented two reinforcement learning algorithms in the EvoSuite unit test generation framework, and used these algorithms to dynamically set the fitness functions used during generation for the three goals identified above. We have evaluated our framework, EvoSuiteFIT, on a set of Java case examples. EvoSuiteFIT techniques attain significant improvements for two of the three goals, and show limited improvements on the third when the number of generations of evolution is fixed. Additionally, for two of the three goals, EvoSuiteFIT detects faults missed by the other techniques. The ability to adjust fitness functions allows strategic choices that efficiently produce more effective test suites, and examining these choices offers insight into how to attain our testing goals. We find that adaptive fitness function selection is a powerful technique to apply when an effective fitness function does not already exist for achieving a testing goal.

Defect Prediction Guided Search-Based Software Testing

Using Defect Prediction to Improve the Bug Detection Capability of Search-Based Software Testing

How good does a Defect Predictor need to be to guide Search-Based Software Testing?

On the Impact of Lower Recall and Precision in Defect Prediction for Guiding Search-Based Software Testing

Graph-based Seed Object Synthesis for Search-Based Unit Testing

Software defects prediction by metaheuristics tuned extreme gradient boosting and analysis based on Shapley Additive Explanations

Test-Data Generation Guided by Static Defect Detection

A Systematic Survey of Just-in-Time Software Defect Prediction

Improving Defect Detection Ability of Derived Test Cases Based on Mutated UML Activity Diagrams

Learning How to Search: Generating Effective Test Cases Through Adaptive Fitness Function Selection

Search-Based Software Test Data Generation for Path Coverage Based on a Feedback-Directed Mechanism

A Novel Multi-Objective Learning-to-rank Method for Software Defect Prediction.

Deep Learning-Based Software Defect Prediction via Semantic Key Features of Source Code—Systematic Survey

Software defect prediction based on nested-stacking and heterogeneous feature selection

Software Defect Prediction with Bayesian Approaches

The Impact of Defect (Re) Prediction on Software Testing

Software Defect Prediction Using Semi-Supervised Learning with Change Burst Information

Open-source Defect Injection Benchmark Testbed for the Evaluation of Testing

A Review On Software Defects Prediction Methods

What You See Is What You Get: Attention-based Self-guided Automatic Unit Test Generation

Improving Software Defect Prediction by Combining the Information of Class and Package