Abstract:Spectrum-based fault localization (SBFL) techniques are widely studied and have been evaluated to be effective in locating faults. Recent studies also showed that developers from industry value automated SBFL techniques. However, their effectiveness is still limited by two main reasons. First, the test coverage information leveraged to construct the spectrum does not reflect the root cause directly. Second, SBFL suffers from the tie issue so that the buggy code entities can not be well differentiated from non-buggy ones. To address these challenges, we propose to leverage the information of version histories in fault localization based on the following two intuitions. First, version histories record how bugs are introduced to software projects and this information reflects the root cause of bugs directly. Second, the evolution histories of code can help differentiate those suspicious code entities ranked in tie by SBFL. Our intuitions are also inspired by the observations on debugging practices from large open source projects and industry. Based on the intuitions, we propose a novel technique HSFL (historical spectrum based fault localization). Specifically, HSFL identifies bug-inducing commits from the version history in the first step. It then constructs historical spectrum (denoted as Histrum) based on bug-inducing commits, which is another dimension of spectrum orthogonal to the coverage based spectrum used in SBFL. HSFL finally ranks the suspicious code elements based on our proposed Histrum and the conventional spectrum. HSFL outperforms the state-of-the-art SBFL techniques significantly on the Defects4J benchmark. Specifically, it locates and ranks the buggy statement at Top-1 for 77.8 percent more bugs as compared with SBFL, and 33.9 percent more bugs at Top-5. Besides, for the metrics MAP and MRR, HSFL achieves an average improvement of 28.3 and 40.8 percent over all bugs, respectively. Moreover, HSFL can also outperform other six families of fault localization techniques, and our proposed Histrum model can be integrated with different families of techniques and boost their performance.

Impacts of Test Suite's Class Imbalance on Spectrum-Based Fault Localization Techniques

An Effective Strategy to Build Up a Balanced Test Suite for Spectrum-Based Fault Localization

Spectrum-Based Fault Localization: Testing Oracles Are No Longer Mandatory

Metamorphic Slice: an Application in Spectrum-Based Fault Localization.

Improving Spectrum-Based Fault Localization Using Quality Assessment and Optimization of a Test Suite

UTDCS-0710 Spectrum-Based Fault Localization without Test Oracles

Backward Slices are Better than Execution Slices in Spectrum-based Fault Localization

Improving Spectrum-Based Localization of Multiple Faults by Iterative Test Suite Reduction

An Analysis on the Negative Effect of Multiple-Faults for Spectrum-Based Fault Localization.

Fault Classification Oriented Spectrum Based Fault Localization

A Vector Table Model-Based Systematic Analysis of Spectral Fault Localization Techniques.

A Preliminary Investigation on the Performance of SBFL Techniques and Distance Metrics in Parallel Fault Localization

Alleviating the Impact of Coincidental Correctness on the Effectiveness of SFL by Clustering Test Cases.

Improving spectral-based fault localization using static analysis.

Theoretical Analysis and Empirical Study on the Impact of Coincidental Correct Test Cases in Multiple Fault Localization

Spectrum-Based and Program Slicing Statistical Fault Localization

A Test Suite Reduction Approach to Improving the Effectiveness of Fault Localization

An Improvement to Fault Localization Technique Based on Branch-Coverage Spectra.

Historical Spectrum Based Fault Localization

Backward-Slice-Based Statistical Fault Localization without Test Oracles

MCFL: Improving Fault Localization by Differentiating Missing Code and Other Faults