Abstract:Random testing and partition testing are two major families of software testing techniques. They have been compared both theoretically and empirically in numerous studies for decades, and it has been widely acknowledged that they have their own advantages and disadvantages and that their innate characteristics are fairly complementary to each other. Some work has been conducted to develop advanced testing techniques through the integration of random testing and partition testing, attempting to preserve the advantages of both while minimizing their disadvantages. In this paper, we propose a new testing approach, adaptive partition testing, where test cases are randomly selected from some partition whose probability of being selected is adaptively adjusted along the testing process. We particularly develop two algorithms, Markov-chain based adaptive partition testing and reward-punishment based adaptive partition testing, to implement the proposed approach. The former algorithm makes use of Markov matrix to dynamically adjust the probability of a partition to be selected for conducting tests; while the latter is based on a reward and punishment mechanism. We conduct empirical studies to evaluate the performance of the proposed algorithms using ten faulty versions of three large-scale open source programs. Our experimental results show that, compared with two baseline techniques, namely random partition testing (RPT) and dynamic random testing (DRT), our algorithms deliver higher fault-detection effectiveness with lower test case selection overhead. It is demonstrated that the proposed adaptive partition testing is an effective testing approach, taking advantages of both random testing and partition testing.

On Enhancing Adaptive Random Testing for AADL Model

Enhancing Performance of Random Testing Through Markov Chain Monte Carlo Methods

A Model-Based Testing for AADL Model of Embedded Software

A Model-based testing methodology for AADL model

An Improved Approach to Adaptive Testing

An Experimental Study of Adaptive Testing for Software Reliability Assessment

Automatic Generation of Systematic Test Cases Using AADL for Embedded Software

Adaptive Partition Testing.

Adaptive Software Testing in the Context of an Improved Controlled Markov Chain Model

Enhancing Software Reliability Estimates Using Modified Adaptive Testing

Optimal and Adaptive Testing for Software Reliability Assessment

A Survey on Adaptive Random Testing

Adaptive Software Testing with Fixed-Memory Feedback.

Design and Application of a Response-Driven Adaptive Test System

Adaptive Random Testing by Exclusion Through Test Profile

Research of Embedded Software Testing Method Based on AADL Modes

Adaptive and Random Partition Software Testing

Adaptive Random Testing of Mobile Application

A Parallel Implementation Strategy of Adaptive Testing

Research on Model-based Testing on AADL

Combining Model Checking and Testing with an Application to Reliability Prediction and Distribution