Abstract:Combinatorial testing (CT) is very efficient to test parameterized systems. Kuhn et al. investigated the interaction faults of some real programs, and found that the faulty combinations are caused by the combination of no more than 6 parameters. Three or fewer parameters triggered a total of almost 90% of the failures in the application[3]. However, for high-quality software, simply testing all 3-way combinations is not sufficient [5], which may increase the risk of residual errors that lead to system failures and security weakness[4]. In addition, the number of test cases at 100% coverage for high-way is huge, which is beyond the farthest test overhead restrictions. Covering array is typically used as the test suite in CT, which should convey much information for the fault detection. We firstly proposed a weighted combinatorial coverage (CC), focusing on the fault detection capability of each test case instead of 100% percent t-way CC. Secondly, we give the test case selection algorithm FWA (fixed weight algorithm) using weighted CC metric. For generating each test case, our method first randomly generates several candidates, and selects the one that has the highest fault-detection possibility with the different sampling pool size. Thirdly, we give the theorems for our algorithm and definitions for the weighted CC. Finally, we compared the selected sample sized and the fault-detection capabilities of FWA as well as t-wise algorithms by using the four benchmarks with configuration options interaction faults, and we found FWA is able to detect higher number of faults with the less selected sample size, specifically, FWA is able to detect high-wise interaction faults with the less selected sample size compared with the 4-wise as well as 5-wise algorithms.

Adaptive Combinatorial Testing

A Case Study of Adaptive Combinatorial Testing

A survey of combinatorial testing

An Interleaving Approach to Combinatorial Testing and Failure-Inducing Interaction Identification

Combinatorial testing, random testing, and adaptive random testing for detecting interaction triggered failures

Isolating Failure-Inducing Combinations in Combinatorial Testing Using Test Augmentation and Classification

Adaptive Interaction Fault Location Based on Combinatorial Testing

Applying Combinatorial Testing in Industrial Settings

An Improved Approach to Adaptive Testing

Improving MC/DC and Fault Detection Strength Using Combinatorial Testing.

Survey of combinatorial test generation

An Empirical Comparison of Combinatorial Testing, Random Testing and Adaptive Random Testing

A Weight-based Approach to Combinatorial Test Generation

Locating Faulty Code Using Failure-Causing Input Combinations in Combinatorial Testing

A Survey of Constrained Combinatorial Testing

Adaptive Software Testing in the Context of an Improved Controlled Markov Chain Model

Adaptive Random Test Case Generation for Combinatorial Testing

The Minimal Failure-Causing Schema of Combinatorial Testing.

How Effective is Branch-Based Combinatorial Testing? an Exploratory Study

Enhance Combinatorial Testing with Metamorphic Relations

A Practical Approach to Combinatorial Test Design