Abstract:Combinatorial interaction testing is a well-recognized testing method, and has been widely applied in practice, often with the assumption that all test cases in a combinatorial test suite have the same fault detection capability. However, when testing resources are limited, an alternative assumption may be that some test cases are more likely to reveal failure, thus making the order of executing the test cases critical. To improve testing cost-effectiveness, prioritization of combinatorial test cases is employed. The most popular approach is based on interaction coverage, which prioritizes combinatorial test cases by repeatedly choosing an unexecuted test case that covers the largest number of uncovered parameter value combinations of a given strength (level of interaction among parameters). However, this approach suffers from some drawbacks. Based on previous observations that the majority of faults in practical systems can usually be triggered with parameter interactions of small strengths, we propose a new strategy of prioritizing combinatorial test cases by incrementally adjusting the strength values. Experimental results show that our method performs better than the random prioritization technique and the technique of prioritizing combinatorial test suites according to test case generation order, and has better performance than the interaction-coverage-based test prioritization technique in most cases.

Machine Learning based Combinatorial Test Cases Ordering Approach

PRIORITIZATION OF COMBINATORIAL TEST CASES BY INCREMENTAL INTERACTION COVERAGE

Towards Optimal Concolic Testing

Adaptive Combinatorial Testing

A Case Study of Adaptive Combinatorial Testing

Greedy Heuristic Algorithms to Generate Variable Strength Combinatorial Test Suite.

COST-COGNIZANT COMBINATORIAL TEST CASE PRIORITIZATION

Isolating Failure-Inducing Combinations in Combinatorial Testing Using Test Augmentation and Classification

Identifying Failure-Inducing Combinations in a Combinatorial Test Set

An Overview of Search Based Combinatorial Testing

An Effective Approach to High Strength Covering Array Generation in Combinatorial Testing

Survey of combinatorial test generation

An Interleaving Approach to Combinatorial Testing and Failure-Inducing Interaction Identification

A survey of combinatorial testing

A Software Failure Debugging Method Based on Combinatorial Design Approach for Testing

Generate Test Cases for Combinatorial Testing Based on Genetic Algorithm

How Effective is Branch-Based Combinatorial Testing? an Exploratory Study

Design of Combinational Test Case Automatic Generation Software

An Algorithm for Fault Diagnosis Based on Combinatorial Design Approach for Testing

Optimal Test Suite Generation Methods for Neighbor Factors Combinatorial Testing

Generating Variable Strength Combinatorial Test Suite with One-test-at-a-time Strategy