Abstract:Spectrum-based fault localization (SBFL) techniques are widely studied and have been evaluated to be effective in locating faults. Recent studies also showed that developers from industry value automated SBFL techniques. However, their effectiveness is still limited by two main reasons. First, the test coverage information leveraged to construct the spectrum does not reflect the root cause directly. Second, SBFL suffers from the tie issue so that the buggy code entities can not be well differentiated from non-buggy ones. To address these challenges, we propose to leverage the information of version histories in fault localization based on the following two intuitions. First, version histories record how bugs are introduced to software projects and this information reflects the root cause of bugs directly. Second, the evolution histories of code can help differentiate those suspicious code entities ranked in tie by SBFL. Our intuitions are also inspired by the observations on debugging practices from large open source projects and industry. Based on the intuitions, we propose a novel technique HSFL (historical spectrum based fault localization). Specifically, HSFL identifies bug-inducing commits from the version history in the first step. It then constructs historical spectrum (denoted as Histrum) based on bug-inducing commits, which is another dimension of spectrum orthogonal to the coverage based spectrum used in SBFL. HSFL finally ranks the suspicious code elements based on our proposed Histrum and the conventional spectrum. HSFL outperforms the state-of-the-art SBFL techniques significantly on the Defects4J benchmark. Specifically, it locates and ranks the buggy statement at Top-1 for 77.8 percent more bugs as compared with SBFL, and 33.9 percent more bugs at Top-5. Besides, for the metrics MAP and MRR, HSFL achieves an average improvement of 28.3 and 40.8 percent over all bugs, respectively. Moreover, HSFL can also outperform other six families of fault localization techniques, and our proposed Histrum model can be integrated with different families of techniques and boost their performance.

A Preliminary Investigation on the Performance of SBFL Techniques and Distance Metrics in Parallel Fault Localization

A General Noise-Reduction Framework for Fault Localization of Java Programs.

A Dynamic Fault Localization Technique with Noise Reduction for Java Programs

"Automated Debugging Considered Harmful" Considered Harmful A User Study Revisiting the Usefulness of Spectra-Based Fault Localization Techniques with Professionals Using Real Bugs from Large Systems

An empirical study on clustering for isolating bugs in fault localization

Isolating Suspiciousness from Spectrum-Based Fault Localization Techniques

Theoretical Analysis and Empirical Study on the Impact of Coincidental Correct Test Cases in Multiple Fault Localization

Combining Spectrum-Based Fault Localization and Statistical Debugging - An Empirical Study.

A fault localization approach based on fault propagation context

A Study of Modified Testing-Based Fault Localization Method

Boosting Spectrum-Based Fault Localization via Multi-Correct Programs in Online Programming

Historical Spectrum Based Fault Localization

Spectrum-Based Fault Localization: Testing Oracles Are No Longer Mandatory

Improving Spectrum-Based Localization of Multiple Faults by Iterative Test Suite Reduction

A Hybrid Approach to Fine-grained Automated Fault Localization

Improving Fault-Localization Accuracy by Referencing Debugging History to Alleviate Structure Bias in Code Suspiciousness

Search-based fault localization

PSC-SBFL: combining PSC with SBFL to improve software fault localization

A similarity-aware approach to testing based fault localization.

Evaluation and Analysis of Spectrum-Based Fault Localization with Modified Similarity Coefficients for Software Debugging

VSBFL: Variable Value Sequence Based Fault Localization for Novice Programs