Abstract:Combinatorial Testing (CT) is an effective testing technique for detecting failures which are triggered by the interactions of various factors that influence the behaviour of a system. Although many studies in CT have designed elaborate test suites (called covering arrays) to systemically check each possible factor interaction, they provide weak support to locate the concrete failure-inducing interactions, i.e., the Minimal Failure-causing Schemas (MFS). To this end, a variety of MFS identification approaches have been proposed. However, as this study reveals, these approaches suffer from various issues such as cannot identify multiple overlapping MFSs, cannot handle MFSs with high degrees, cannot be applied to systems with large number of parameters, etc. These issues are essentially caused by the exponential computing complexity of checking every interaction in the test cases. Therefore, they can only focus on a subset of all the possible interactions, resulting in many interactions unnoticed. Ignoring these unnoticed interactions could potentially cause failures that have never been systematically checked. Hence, it is beneficial for MFS identification approaches to identify these interactions. In order to account for these unnoticed interactions in CT, this study introduces the notion of pending schema, based on which a theoretical framework of CT schemas is established. In particular, we formally define the determinability of a schema in CT with respect to given information; as such, the yet-to-be determined schemas are exactly the pending schemas. The relationships between the different schemas (faulty, healthy, and pending) and test cases are also theoretically analyzed. Based on which, we further propose three formulas, along with three corresponding algorithms, for the identification of the pending schemas in failing test cases, and formally prove their correctness. As a result, we reduce the complexity of obtaining pending schemas with respect to the number of factors that may have influences on the software.

Locating Errors in Combinatorial Testing Using Set of Possible Faulty Interactions

An Adaptive Algorithm of Locating Fault Interactions Based Combinatorial Testing

Locating Minimal Fault Interaction in Combinatorial Testing.

Adaptive Interaction Fault Location Based on Combinatorial Testing

Locating Faulty Code Using Failure-Causing Input Combinations in Combinatorial Testing

An Interleaving Approach to Combinatorial Testing and Failure-Inducing Interaction Identification

Locating Error Interactions Based on Partial Covering Array

A Combinatorial Testing-Based Approach to Fault Localization

Generating combinatorial test suite for interaction relationship.

Locating One Pairwise Interaction: Three Recursive Constructions

A Weight-based Approach to Combinatorial Test Generation

Faster Location in Combinatorial Interaction Testing

Software fault diagnosis method based on combinatorial testing

Theoretical Analysis and Empirical Study on the Impact of Coincidental Correct Test Cases in Multiple Fault Localization

A Software Failure Debugging Method Based on Combinatorial Design Approach for Testing

A Theory of Pending Schemas in Combinatorial Testing

Identifying Failure-Inducing Combinations in a Combinatorial Test Set

An Algorithm for Fault Diagnosis Based on Combinatorial Design Approach for Testing

An insight of double-faults interactions in program: An empirical study

Alleviating the Impact of Coincidental Correctness on the Effectiveness of SFL by Clustering Test Cases.

Proposing an Effective Software Fault Location Algorithm Based on Frequency Difference Integration