Abstract:Change-level defect prediction is widely referred to as just-in-time (JIT) defect prediction since it identifies a defect-inducing change at the check-in time, and researchers have proposed many approaches based on the language-independent change-level features. These approaches can be divided into two types: supervised approaches and unsupervised approaches, and their effectiveness has been verified on Java or C++ projects. However, whether the language-independent change-level features can effectively identify the defects of JavaScript projects is still unknown. Additionally, many researches have confirmed that supervised approaches outperform unsupervised approaches on Java or C++ projects when considering inspection effort. However, whether supervised JIT defect prediction approaches can still perform best on JavaScript projects is still unknown. Lastly, prior proposed change-level features are programming language-independent, whether programming language-specific change-level features can further improve the performance of JIT approaches on identifying defect-prone changes is also unknown. To address the aforementioned gap in knowledge, in this paper, we collect and label top-20 most starred JavaScript projects on GitHub. JavaScript is an extremely popular and widely used programming language in the industry. We propose five JavaScript-specific change-level features and conduct a large-scale empirical study (i.e., involving a total of 176,902 changes) and find that 1) supervised JIT defect prediction approaches (i.e., CBS+) still statistically significantly outperform unsupervised approaches on JavaScript projects when considering inspection effort; 2) JavaScript-specific change-level features can further improve the performance of approach built with language-independent features on identifying defect-prone changes; 3) the change-level features in the dimension of size (i.e., LT), diffusion (i.e., NF), and JavaScript-specific (i.e., SO and TC) are the most important features for indicating the defect-proneness of a change on JavaScript projects; and 4) project-related features (i.e., Stars, Branches, Def Ratio, Changes, Files, Defective and Forks) have a high association with the probability of a change to be a defect-prone one on JavaScript projects.

A Systematic Survey of Just-in-Time Software Defect Prediction

A Procedure to Continuously Evaluate Predictive Performance of Just-In-Time Software Defect Prediction Models During Software Development

Just-in-time Defect Prediction for Software Hunks

Towards Reliable Online Just-in-Time Software Defect Prediction

Just-In-Time Defect Identification and Localization: A Two-Phase Framework.

Human-in-the-loop online just-in-time software defect prediction

The Need for a Fine-grained approach in Just-in-Time Defect Prediction

Deep Incremental Learning of Imbalanced Data for Just-In-Time Software Defect Prediction

An empirical study of data sampling techniques for just-in-time software defect prediction

Comparative Study of Ensemble Learning Methods in Just-in-time Software Defect Prediction

On the validity of retrospective predictive performance evaluation procedures in just-in-time software defect prediction

Deep Learning for Just-In-Time Defect Prediction

IRJIT: A Simple, Online, Information Retrieval Approach for Just-In-Time Software Defect Prediction

A Differential Evolution-Based Approach for Effort-Aware Just-in-time Software Defect Prediction

DEJIT: A Differential Evolution Algorithm for Effort-Aware Just-in-Time Software Defect Prediction

Software defect prediction based on nested-stacking and heterogeneous feature selection

Effort-Aware semi-Supervised just-in-Time defect prediction

A novel instance‐based method for cross‐project just‐in‐time defect prediction

Detecting Concept Drift for the reliability prediction of Software Defects using Instance Interpretation

Just-In-Time Defect Prediction on JavaScript Projects: A Replication Study

Boosting multi-objective just-in-time software defect prediction by fusing expert metrics and semantic metrics