Abstract:Program debugging is a time-consuming task, and researchers have proposed different kinds of automatic fault localization techniques to mitigate the burden of manual debugging. Among these techniques, two popular families are spectrum-based fault localization (SBFL) and statistical debugging (SD), both localizing faults by collecting statistical information at runtime. Though the ideas are similar, the two families have been developed independently and their combinations have not been systematically explored. In this paper we perform a systematical empirical study on the combination of SBFL and SD. We first build a unified model of the two techniques, and systematically explore four types of variations, different predicates, different risk evaluation formulas, different granularities of data collection, and different methods of combining suspicious scores. Our study leads to several findings. First, most of the effectiveness of the combined approach contributed by a simple type of predicates: branch conditions. Second, the risk evaluation formulas of SBFL significantly outperform that of SD. Third, fine-grained data collection significantly outperforms coarse-grained data collection with a little extra execution overhead. Fourth, a linear combination of SBFL and SD predicates outperforms both individual approaches. According to our empirical study, we propose a new fault localization approach, PredFL (Predicate-based Fault Localization), with the best configuration for each dimension under the unified model. Then, we explore its complementarity to existing techniques by integrating PredFL with a state-of-the-art fault localization framework. The experimental results show that PredFL can further improve the effectiveness of state-of-the-art fault localization techniques. More concretely, integrating PredFL results in an up to 20.8% improvement w.r.t the faults successfully located at Top-1, which reveals that PredFL complements existing techniques.

An In-Depth Study of the Efficiency of Risk Evaluation Formulas for Multi-Fault Localization

A Theoretical Analysis of the Risk Evaluation Formulas for Spectrum-Based Fault Localization

A General Noise-Reduction Framework for Fault Localization of Java Programs.

A Dynamic Fault Localization Technique with Noise Reduction for Java Programs

Isolating Suspiciousness from Spectrum-Based Fault Localization Techniques

A Multi-level Approach for Complex Fault Isolation Based on Structured Residuals

Combining Spectrum-Based Fault Localization and Statistical Debugging - An Empirical Study.

An If-While-If Model-Based Performance Evaluation of Ranking Metrics for Spectra-Based Fault Localization

Boosting Spectrum-Based Fault Localization via Multi-Correct Programs in Online Programming

Theoretical Analysis and Empirical Study on the Impact of Coincidental Correct Test Cases in Multiple Fault Localization

Improving Spectrum-Based Localization of Multiple Faults by Iterative Test Suite Reduction

A Preliminary Investigation on the Performance of SBFL Techniques and Distance Metrics in Parallel Fault Localization

Search-based fault localization

An empirical study on clustering for isolating bugs in fault localization

A Hybrid Approach to Fine-grained Automated Fault Localization

A fault localization approach based on fault propagation context

Spectrum-Based Fault Localization: Testing Oracles Are No Longer Mandatory

An Empirical Study of Fault Localization Families and Their Combinations

UTDCS-0710 Spectrum-Based Fault Localization without Test Oracles

An effective fault localization approach based on PageRank and mutation analysis

Improving Fault-Localization Accuracy by Referencing Debugging History to Alleviate Structure Bias in Code Suspiciousness