Abstract:Program debugging is a time-consuming task, and researchers have proposed different kinds of automatic fault localization techniques to mitigate the burden of manual debugging. Among these techniques, two popular families are spectrum-based fault localization (SBFL) and statistical debugging (SD), both localizing faults by collecting statistical information at runtime. Though the ideas are similar, the two families have been developed independently and their combinations have not been systematically explored. In this paper we perform a systematical empirical study on the combination of SBFL and SD. We first build a unified model of the two techniques, and systematically explore four types of variations, different predicates, different risk evaluation formulas, different granularities of data collection, and different methods of combining suspicious scores. Our study leads to several findings. First, most of the effectiveness of the combined approach contributed by a simple type of predicates: branch conditions. Second, the risk evaluation formulas of SBFL significantly outperform that of SD. Third, fine-grained data collection significantly outperforms coarse-grained data collection with a little extra execution overhead. Fourth, a linear combination of SBFL and SD predicates outperforms both individual approaches. According to our empirical study, we propose a new fault localization approach, PredFL (Predicate-based Fault Localization), with the best configuration for each dimension under the unified model. Then, we explore its complementarity to existing techniques by integrating PredFL with a state-of-the-art fault localization framework. The experimental results show that PredFL can further improve the effectiveness of state-of-the-art fault localization techniques. More concretely, integrating PredFL results in an up to 20.8% improvement w.r.t the faults successfully located at Top-1, which reveals that PredFL complements existing techniques.

Fault Localization Method of Combining Statement Execution Complement

A Combinatorial Testing-Based Approach to Fault Localization

A fault localization method based on model combination

Combining Spectrum-Based Fault Localization and Statistical Debugging - An Empirical Study.

A Fault-Localization Approach Based on the Coincidental Correctness Probability

Search-based fault localization

A General Noise-Reduction Framework for Fault Localization of Java Programs.

A Dynamic Fault Localization Technique with Noise Reduction for Java Programs

Theoretical Analysis and Empirical Study on the Impact of Coincidental Correct Test Cases in Multiple Fault Localization

An Empirical Study of Fault Localization Families and Their Combinations

Spectrum-Based Fault Localization Method with Test Case Reduction

Spectra-Based Fault Localization by Increasing Marginal Weight

A Hybrid Approach to Fine-grained Automated Fault Localization

Fault Localization Based on Multi-Level Similarity of Execution Traces

Multiple fault localization based on ant colony algorithm via genetic operation

Leveraging Method Call Anomalies to Improve the Effectiveness of Spectrum-Based Fault Localization Techniques for Object-Oriented Programs

A fault localization approach based on fault propagation context

A similarity-aware approach to testing based fault localization.

On similarity-awareness in testing-based fault localization

IPSETFUL: an Iterative Process of Selecting Test Cases for Effective Fault Localization by Exploring Concept Lattice of Program Spectra

A Study of Modified Testing-Based Fault Localization Method