Abstract:Spectrum-based fault localization (SBFL) techniques are widely studied and have been evaluated to be effective in locating faults. Recent studies also showed that developers from industry value automated SBFL techniques. However, their effectiveness is still limited by two main reasons. First, the test coverage information leveraged to construct the spectrum does not reflect the root cause directly. Second, SBFL suffers from the tie issue so that the buggy code entities can not be well differentiated from non-buggy ones. To address these challenges, we propose to leverage the information of version histories in fault localization based on the following two intuitions. First, version histories record how bugs are introduced to software projects and this information reflects the root cause of bugs directly. Second, the evolution histories of code can help differentiate those suspicious code entities ranked in tie by SBFL. Our intuitions are also inspired by the observations on debugging practices from large open source projects and industry. Based on the intuitions, we propose a novel technique HSFL (historical spectrum based fault localization). Specifically, HSFL identifies bug-inducing commits from the version history in the first step. It then constructs historical spectrum (denoted as Histrum) based on bug-inducing commits, which is another dimension of spectrum orthogonal to the coverage based spectrum used in SBFL. HSFL finally ranks the suspicious code elements based on our proposed Histrum and the conventional spectrum. HSFL outperforms the state-of-the-art SBFL techniques significantly on the Defects4J benchmark. Specifically, it locates and ranks the buggy statement at Top-1 for 77.8 percent more bugs as compared with SBFL, and 33.9 percent more bugs at Top-5. Besides, for the metrics MAP and MRR, HSFL achieves an average improvement of 28.3 and 40.8 percent over all bugs, respectively. Moreover, HSFL can also outperform other six families of fault localization techniques, and our proposed Histrum model can be integrated with different families of techniques and boost their performance.

An If-While-If Model-Based Performance Evaluation of Ranking Metrics for Spectra-Based Fault Localization

An In-Depth Study of the Efficiency of Risk Evaluation Formulas for Multi-Fault Localization

Improving Spectrum-Based Localization of Multiple Faults by Iterative Test Suite Reduction

"Automated Debugging Considered Harmful" Considered Harmful A User Study Revisiting the Usefulness of Spectra-Based Fault Localization Techniques with Professionals Using Real Bugs from Large Systems

A General Noise-Reduction Framework for Fault Localization of Java Programs.

Locating Faults Using Multiple Spectra-Specific Models.

A Theoretical Analysis of the Risk Evaluation Formulas for Spectrum-Based Fault Localization

Evaluating data-flow coverage in spectrum-based fault localization

An effective fault localization approach based on PageRank and mutation analysis

Boosting Spectrum-Based Fault Localization via Multi-Correct Programs in Online Programming

ALBFL: A Novel Neural Ranking Model for Software Fault Localization Via Combining Static and Dynamic Features

A Preliminary Investigation on the Performance of SBFL Techniques and Distance Metrics in Parallel Fault Localization

Improving the Accuracy of Spectrum-Based Fault Localization Using Multiple Rules.

A Hybrid Approach to Fine-grained Automated Fault Localization

Isolating Suspiciousness from Spectrum-Based Fault Localization Techniques

Evaluation and Analysis of Spectrum-Based Fault Localization with Modified Similarity Coefficients for Software Debugging

Historical Spectrum Based Fault Localization

Search-based fault localization

Spectrum-Based Fault Localization: Testing Oracles Are No Longer Mandatory

VSBFL: Variable Value Sequence Based Fault Localization for Novice Programs

IPSETFUL: an Iterative Process of Selecting Test Cases for Effective Fault Localization by Exploring Concept Lattice of Program Spectra