Abstract:Defect localization aims to locate buggy program elements (e.g., buggy files, methods or lines of code) based on defect symptoms, e.g., bug reports or program spectrum. However, when we receive the defect symptoms, the defect has been exposed and negative impacts have been introduced. Thus, one challenging task is: whether we can locate buggy program prior to the appearance of the defect symptom (e.g., when buggy program elements are being committed to a version control system). We refer to this type of defect localization as “Just-In-Time (JIT) Defect localization”. Although many prior studies have proposed various JIT defect identification methods to identify whether a new change is buggy, these prior methods do not locate the suspicious positions. Thus, JIT defect localization is the next step of JIT defect identification (i.e., after a buggy change is identified, suspicious source code lines are located). To address this problem, we propose a two-phase framework, i.e., JIT defect identification and JIT defect localization. Given a new change, JIT defect identification will identify it as buggy change or clean change first. If a new change is identified as buggy, JIT defect localization will rank the source code lines introduced by the new change according to their suspiciousness scores. The source code lines ranked at the top of the list are estimated as the defect location. For JIT defect identification phase, we use 14 change-level features to build a classifier by following existing approach. For JIT defect localization phase, we propose a JIT defect localization approach that leverages software naturalness with the N-gram model. To evaluate the proposed framework, we conduct an empirical study on 14 open source projects with a total of 177,250 changes. The results show that software naturalness is effective for our JIT defect localization. Our model achieves a reasonable performance, and outperforms the two baselines (i.e., random guess and a static bug finder (i.e., PMD)) by a substantial margin in terms of four ranking measures.

Notice of Retraction: A Method of Improving Precision in Software Testing Based on Defect Patterns

Just-In-Time Defect Identification and Localization: A Two-Phase Framework.

Can Defects Be Fixed with Weak Test Suites? an Analysis of 50 Defects from Defects4J

Notice of Retraction Evaluating instructors' performance based on Set Pair Analysis

On the Impact of Lower Recall and Precision in Defect Prediction for Guiding Search-Based Software Testing

Application of Three-Repetition Tests Scheme to Improve Integrated Circuits Test Quality to Near-Zero Defect

Testing Effort Dependent Software Reliability Model for Imperfect Debugging Process Considering Both Detection and Correction.

Estimate the Precision of Defects Based on Reports Duplication in Crowdsourced Testing

A Manual Inspection of Defects4J Bugs and Its Implications for Automatic Program Repair

On the validity of retrospective predictive performance evaluation procedures in just-in-time software defect prediction

Improving the Efficiency of Software Reliability Demonstration Testing by Introducing Testing Effectiveness

Detecting Concept Drift for the reliability prediction of Software Defects using Instance Interpretation

A Systematic Survey of Just-in-Time Software Defect Prediction

Notice of Retraction An enhanced ultrasonic automatic detecting system for locomotive axles

Static Analysis Refinement on Defect Path Segment

Failure-Directed Program Trimming (Extended Version)

Defect-Oriented Test Case Prioritization

Towards Reliable Online Just-in-Time Software Defect Prediction

An Efficient Diagnostic Test Pattern Generation Framework

Defect Identification, Categorization, and Repair: Better Together

Improved metrics for evaluating fault detection efficiency of test suite