Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Context:</h3><p>Generally, there are more non-defective instances than defective instances in the datasets used for software defect prediction (SDP), which is referred to as the class imbalance problem. Oversampling techniques are frequently adopted to alleviate the problem by generating new synthetic defective instances. Existing techniques generate either near-duplicated instances which result in overgeneralization (high probability of false alarm, <span class="math"><math>pf</math></span>) or overly diverse instances which hurt the prediction model's ability to find defects (resulting in low probability of detection, <span class="math"><math>pd</math></span>). Furthermore, when existing oversampling techniques are applied in SDP, the effort needed to inspect the instances with different complexity is not taken into consideration.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Objective:</h3><p>In this study, we introduce Complexity-based OverSampling TEchnique (COSTE), a novel oversampling technique that can achieve low <span class="math"><math>pf</math></span> and high <span class="math"><math>pd</math></span> simultaneously. Meanwhile, COSTE also performs better in terms of <span class="math"><math>Norm(popt)</math></span> and <span class="math"><math>ACC</math></span>, two effort-aware measures that consider the testing effort.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Method:</h3><p>COSTE combines pairs of defective instances with similar complexity to generate synthetic instances, which improves the diversity within the data, maintains the ability of prediction models to find defects, and takes the different testing effort needed for different instances into consideration. We conduct experiments to compare COSTE with Synthetic Minority Oversampling TEchnique, Borderline-SMOTE, Majority Weighted Minority Oversampling TEchnique and MAHAKIL.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results:</h3><p>The experimental results on 23 releases of 10 projects show that COSTE greatly improves the diversity of the synthetic instances without compromising the ability of prediction models to find defects. In addition, COSTE outperforms the other oversampling techniques under the same testing effort. The statistical analysis indicates that COSTE's ability to outperform the other oversampling techniques is significant under the statistical Wilcoxon rank sum test and Cliff's effect size.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusion:</h3><p>COSTE is recommended as an efficient alternative to address the class imbalance problem in SDP.</p>

The impact of the distance metric and measure on SMOTE-based techniques in software defect prediction

Investigation on the stability of SMOTE-based oversampling techniques in software defect prediction

PF-SMOTE: A Novel Parameter-Free SMOTE for Imbalanced Datasets

COSTE: Complexity-based OverSampling TEchnique to alleviate the class imbalance problem in software defect prediction

SMOTE-WENN: Solving class imbalance and small sample problems by oversampling and distance scaling

DDSC-SMOTE: an imbalanced data oversampling algorithm based on data distribution and spectral clustering

Tackling Class Imbalance Problem In Software Defect Prediction Through Cluster-Based Over-Sampling With Filtering

Over-sampling algorithm for imbalanced data classification

A Hybrid Sampling and Multi-Objective Optimization Approach for Enhanced Software Defect Prediction

High-Impact Bug Report Identification with Imbalanced Learning Strategies

Do we need rebalancing strategies? A theoretical and empirical study around SMOTE and its variants

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

SP-SMOTE: A novel space partitioning based synthetic minority oversampling technique

Performance evaluation of software defect prediction with NASA dataset using machine learning techniques

A hybrid‐ensemble model for software defect prediction for balanced and imbalanced datasets using AI‐based techniques with feature preservation: SMERKP‐XGB

Combined Classifier for Cross-Project Defect Prediction: an Extended Empirical Study.

Oversampling for Imbalanced Learning Based on K-Means and SMOTE

The Impact of Class Rebalancing Techniques on the Performance and Interpretation of Defect Prediction Models

Diversity based multi-cluster over sampling approach to alleviate the class imbalance problem in software defect prediction

Minimum Enclosing Ball Synthetic Minority Oversampling Technique from a Geometric Perspective

An Oversampling Method of Unbalanced Data for Mechanical Fault Diagnosis Based on MeanRadius-SMOTE