Abstract:Adaptive random testing (ART) is an enhancement of random testing (RT), and aims to improve the RT failure-detection effectiveness by distributing test cases more evenly in the input domain. Many ART algorithms have been proposed, with fixed-size-candidate-set ART (FSCS-ART) being one of the most effective and popular. FSCS-ART ensures high failure-detection effectiveness by selecting as the next test case the candidate farthest from previously executed test cases. Although FSCS-ART has good failure-detection effectiveness, it also faces some challenges, including heavy computational overheads. In this article, we propose an enhanced version of FSCS-ART, vantage point partitioning ART (VPP-ART). VPP-ART addresses the FSCS-ART computational overhead problem using VPP, while maintaining the failure-detection effectiveness. VPP-ART partitions the input domain space using a modified vantage point tree (VP-tree) and finds the approximate nearest executed test cases of a candidate test case in the partitioned subdomains—thereby significantly reducing the time overheads compared with the searches required for FSCS-ART. To enable the FSCS-ART dynamic insertion process, we modify the traditional VP-tree to support dynamic data. The simulation results show that VPP-ART has a much lower time overhead compared to FSCS-ART, but also delivers similar (or better) failure-detection effectiveness, especially in the higher dimensional input domains. According to statistical analyses, VPP-ART can improve on the FSCS-ART failure-detection effectiveness by approximately 50–58%. VPP-ART also compares favorably with the KD-tree-enhanced fixed-size-candidate-set ART (KDFC-ART) algorithms (a series of enhanced ART algorithms based on the KD-tree). Our experiments also show that VPP-ART is more cost-effective than FSCS-ART and KDFC-ART.

Failure-detection Capability Analysis of Implementing Parallelism in Adaptive Random Testing Algorithms

Adaptive Random Test Case Generation for Combinatorial Testing

VPP-ART: An Efficient Implementation of Fixed-Size-Candidate-Set Adaptive Random Testing Using Vantage Point Partitioning

SWFC-ART: A cost-effective approach for Fixed-Size-Candidate-Set Adaptive Random Testing through small world graphs

A Survey on Adaptive Random Testing

Adaptive Random Testing Through Test Profiles

Toward Cost-effective Adaptive Random Testing: An Approximate Nearest Neighbor Approach

An Empirical Comparison of Combinatorial Testing, Random Testing and Adaptive Random Testing

A Taxonomic Review of Adaptive Random Testing: Current Status, Classifications, and Issues

A Parallel Implementation Strategy of Adaptive Testing

Enhancing Performance of Random Testing Through Markov Chain Monte Carlo Methods

Enhancing Mirror Adaptive Random Testing Through Dynamic Partitioning

Combinatorial testing, random testing, and adaptive random testing for detecting interaction triggered failures

A self-adaptive test framework for concurrent programs

Adaptive Random Testing by Exclusion Through Test Profile

An Approach of Iterative Partition Testing Based on Priority Sampling

Improving Failure Detection by Automatically Generating Test Cases Near the Boundaries.

A Comprehensive Empirical Investigation on Failure Clustering in Parallel Debugging

Run‐time Error Detection of Space‐robot Based on Adaptive Redundancy

Adaptive Combinatorial Testing

A Case Study of Adaptive Combinatorial Testing