Abstract:Change-level defect prediction is widely referred to as just-in-time (JIT) defect prediction since it identifies a defect-inducing change at the check-in time, and researchers have proposed many approaches based on the language-independent change-level features. These approaches can be divided into two types: supervised approaches and unsupervised approaches, and their effectiveness has been verified on Java or C++ projects. However, whether the language-independent change-level features can effectively identify the defects of JavaScript projects is still unknown. Additionally, many researches have confirmed that supervised approaches outperform unsupervised approaches on Java or C++ projects when considering inspection effort. However, whether supervised JIT defect prediction approaches can still perform best on JavaScript projects is still unknown. Lastly, prior proposed change-level features are programming language-independent, whether programming language-specific change-level features can further improve the performance of JIT approaches on identifying defect-prone changes is also unknown. To address the aforementioned gap in knowledge, in this paper, we collect and label top-20 most starred JavaScript projects on GitHub. JavaScript is an extremely popular and widely used programming language in the industry. We propose five JavaScript-specific change-level features and conduct a large-scale empirical study (i.e., involving a total of 176,902 changes) and find that 1) supervised JIT defect prediction approaches (i.e., CBS+) still statistically significantly outperform unsupervised approaches on JavaScript projects when considering inspection effort; 2) JavaScript-specific change-level features can further improve the performance of approach built with language-independent features on identifying defect-prone changes; 3) the change-level features in the dimension of size (i.e., LT), diffusion (i.e., NF), and JavaScript-specific (i.e., SO and TC) are the most important features for indicating the defect-proneness of a change on JavaScript projects; and 4) project-related features (i.e., Stars, Branches, Def Ratio, Changes, Files, Defective and Forks) have a high association with the probability of a change to be a defect-prone one on JavaScript projects.

How Well Just-In-Time Defect Prediction Techniques Enhance Software Reliability?

A Systematic Survey of Just-in-Time Software Defect Prediction

Just-in-time Defect Prediction for Software Hunks

Towards Reliable Online Just-in-Time Software Defect Prediction

Just-In-Time Defect Identification and Localization: A Two-Phase Framework.

Just-in-Time Software Defect Prediction: A Road Map

A Procedure to Continuously Evaluate Predictive Performance of Just-In-Time Software Defect Prediction Models During Software Development

Deep Learning for Just-In-Time Defect Prediction

The Need for a Fine-grained approach in Just-in-Time Defect Prediction

On the validity of retrospective predictive performance evaluation procedures in just-in-time software defect prediction

JITLine: A Simpler, Better, Faster, Finer-grained Just-In-Time Defect Prediction

Human-in-the-loop online just-in-time software defect prediction

Just-in-Time Defect Prediction Technology Based on Interpretability Technology

An Empirical Study on the Impact of Class Overlapin Just-in-Time Software Defect Prediction (S).

Interpretability application of the Just-in-Time software defect prediction model

Just-in-Time crash prediction for mobile apps

Effort-aware and just-in-time defect prediction with neural network

Effort-Aware semi-Supervised just-in-Time defect prediction

Does chronology matter in JIT defect prediction? A Partial Replication Study

IRJIT: A Simple, Online, Information Retrieval Approach for Just-In-Time Software Defect Prediction

Just-In-Time Defect Prediction on JavaScript Projects: A Replication Study