Abstract:One major objective of software testing is to reveal software failures such that program bugs can be removed. Random testing is a basic and simple software testing technique, but its failure-detection effectiveness is often controversial. Based on the common observation that program inputs causing software failures tend to cluster into contiguous regions, some researchers have proposed that an even spread of test cases should enhance the failure-detection effectiveness of random testing. Adaptive random testing refers to a family of algorithms to evenly spread random test cases based on various notions. Restricted random testing, an algorithm to implement adaptive random testing by the notion of exclusion, defines an exclusion region around each previously executed test case, and selects test cases only from outside all exclusion regions. Although having a high failure-detection effectiveness, restricted random testing has a very high computation overhead, and it rigidly discards all test cases inside any exclusion region, some of which may reveal software failures. In this paper, we propose a new method to implement adaptive random testing by exclusion, where test cases are simply selected based on a well-designed test profile. The new method has a low computation overhead and it does not omit any possible program inputs that can detect failures. Our experimental results show that the new method not only spreads test cases more evenly but also brings a higher failure-detection effectiveness than random testing.

Bounding Random Test Set Size with Computational Learning Theory

Enhancing Performance of Random Testing Through Markov Chain Monte Carlo Methods

Using Random Test Selection to Gain Confidence in Modified Software

Adaptive Random Testing by Exclusion Through Test Profile

Multi-Level Random Walk for Software Test Suite Reduction

Random Grammar-based Testing for Covering All Non-Terminals

Probabilistic and Systematic Coverage of Consecutive Test-Method Pairs for Detecting Order-Dependent Flaky Tests.

BATON: Symphony of Random Testing and Concolic Testing Through Machine Learning and Taint Analysis

Can Search-Based Testing with Pareto Optimization Effectively Cover Failure-Revealing Test Inputs?

Software Testing As A Problem of Machine Learning: Towards a Foundation on Computational Learning Theory

Uncertainty-Driven Black-Box Test Data Generation

Is Algorithmic Stability Testable? A Unified Framework under Computational Constraints

Improving Failure Detection by Automatically Generating Test Cases Near the Boundaries.

Adaptive Random Test Case Generation for Combinatorial Testing

Adaptive and Random Partition Software Testing

Probabilistic Models for Estimation of Random and Pseudo-Random Test Length

Guiding Random Test Generation with Program Analysis.

A Random Walk Based Algorithm for Structural Test Case Generation

What Not to Test (for Cyber-Physical Systems)

Bypassing Code Coverage Approximation Limitations via Effective Input-Based Randomized Test Case Prioritization

Measuring random tests by conditional entropy and optimal execution order