Abstract:Adaptive random testing (ART) is an enhancement of random testing (RT), and aims to improve the RT failure-detection effectiveness by distributing test cases more evenly in the input domain. Many ART algorithms have been proposed, with fixed-size-candidate-set ART (FSCS-ART) being one of the most effective and popular. FSCS-ART ensures high failure-detection effectiveness by selecting as the next test case the candidate farthest from previously executed test cases. Although FSCS-ART has good failure-detection effectiveness, it also faces some challenges, including heavy computational overheads. In this article, we propose an enhanced version of FSCS-ART, vantage point partitioning ART (VPP-ART). VPP-ART addresses the FSCS-ART computational overhead problem using VPP, while maintaining the failure-detection effectiveness. VPP-ART partitions the input domain space using a modified vantage point tree (VP-tree) and finds the approximate nearest executed test cases of a candidate test case in the partitioned subdomains—thereby significantly reducing the time overheads compared with the searches required for FSCS-ART. To enable the FSCS-ART dynamic insertion process, we modify the traditional VP-tree to support dynamic data. The simulation results show that VPP-ART has a much lower time overhead compared to FSCS-ART, but also delivers similar (or better) failure-detection effectiveness, especially in the higher dimensional input domains. According to statistical analyses, VPP-ART can improve on the FSCS-ART failure-detection effectiveness by approximately 50–58%. VPP-ART also compares favorably with the KD-tree-enhanced fixed-size-candidate-set ART (KDFC-ART) algorithms (a series of enhanced ART algorithms based on the KD-tree). Our experiments also show that VPP-ART is more cost-effective than FSCS-ART and KDFC-ART.

Enhancing Mirror Adaptive Random Testing Through Dynamic Partitioning

An Adaptive Partition-Based Approach for Adaptive Random Testing on Real Programs.

Failure-detection Capability Analysis of Implementing Parallelism in Adaptive Random Testing Algorithms

Enhancing Performance of Random Testing Through Markov Chain Monte Carlo Methods

VPP-ART: An Efficient Implementation of Fixed-Size-Candidate-Set Adaptive Random Testing Using Vantage Point Partitioning

Toward Cost-effective Adaptive Random Testing: An Approximate Nearest Neighbor Approach

Adaptive Partition Testing.

Adaptive Random Testing Through Test Profiles

Adaptive Random Test Case Generation for Combinatorial Testing

An Experimental Evaluation of the Reliability of Adaptive Random Testing Methods

Dynamic Random Testing: Technique and Experimental Evaluation

A Survey on Adaptive Random Testing

Impact of the Compactness of Failure Regions on the Performance of Adaptive Random Testing

An Approach of Iterative Partition Testing Based on Priority Sampling

An Empirical Comparison of Combinatorial Testing, Random Testing and Adaptive Random Testing

Adaptive and Random Partition Software Testing

Adaptive Random Test Case Prioritization

SWFC-ART: A cost-effective approach for Fixed-Size-Candidate-Set Adaptive Random Testing through small world graphs

A Taxonomic Review of Adaptive Random Testing: Current Status, Classifications, and Issues

ARTDL: Adaptive Random Testing for Deep Learning Systems.

A Divergence-Oriented Approach to Adaptive Random Testing of Java Programs