Abstract:Adaptive random testing (ART) is an enhancement of random testing (RT), and aims to improve the RT failure-detection effectiveness by distributing test cases more evenly in the input domain. Many ART algorithms have been proposed, with fixed-size-candidate-set ART (FSCS-ART) being one of the most effective and popular. FSCS-ART ensures high failure-detection effectiveness by selecting as the next test case the candidate farthest from previously executed test cases. Although FSCS-ART has good failure-detection effectiveness, it also faces some challenges, including heavy computational overheads. In this article, we propose an enhanced version of FSCS-ART, vantage point partitioning ART (VPP-ART). VPP-ART addresses the FSCS-ART computational overhead problem using VPP, while maintaining the failure-detection effectiveness. VPP-ART partitions the input domain space using a modified vantage point tree (VP-tree) and finds the approximate nearest executed test cases of a candidate test case in the partitioned subdomains—thereby significantly reducing the time overheads compared with the searches required for FSCS-ART. To enable the FSCS-ART dynamic insertion process, we modify the traditional VP-tree to support dynamic data. The simulation results show that VPP-ART has a much lower time overhead compared to FSCS-ART, but also delivers similar (or better) failure-detection effectiveness, especially in the higher dimensional input domains. According to statistical analyses, VPP-ART can improve on the FSCS-ART failure-detection effectiveness by approximately 50–58%. VPP-ART also compares favorably with the KD-tree-enhanced fixed-size-candidate-set ART (KDFC-ART) algorithms (a series of enhanced ART algorithms based on the KD-tree). Our experiments also show that VPP-ART is more cost-effective than FSCS-ART and KDFC-ART.

Impact of the Compactness of Failure Regions on the Performance of Adaptive Random Testing

An Experimental Evaluation of the Reliability of Adaptive Random Testing Methods

Failure-detection Capability Analysis of Implementing Parallelism in Adaptive Random Testing Algorithms

Adaptive Random Test Case Generation for Combinatorial Testing

An Adaptive Partition-Based Approach for Adaptive Random Testing on Real Programs.

Adaptive Random Testing Through Test Profiles

An Empirical Comparison of Combinatorial Testing, Random Testing and Adaptive Random Testing

A Taxonomic Review of Adaptive Random Testing: Current Status, Classifications, and Issues

A Survey on Adaptive Random Testing

Combinatorial testing, random testing, and adaptive random testing for detecting interaction triggered failures

SWFC-ART: A cost-effective approach for Fixed-Size-Candidate-Set Adaptive Random Testing through small world graphs

VPP-ART: An Efficient Implementation of Fixed-Size-Candidate-Set Adaptive Random Testing Using Vantage Point Partitioning

Toward Cost-effective Adaptive Random Testing: An Approximate Nearest Neighbor Approach

Adaptive Random Test Case Prioritization

Enhancing Mirror Adaptive Random Testing Through Dynamic Partitioning

ARTDL: Adaptive Random Testing for Deep Learning Systems.

Adaptive Random Testing by Exclusion Through Test Profile

Adaptive Partition Testing.

Research on Advanced Adaptive Random Testing by Localization

A Divergence-Oriented Approach to Adaptive Random Testing of Java Programs

Adaptive Random Testing of Mobile Application