Abstract:Software defect prediction helps developers focus on defective modules for efficient software quality assurance. A common goal shared by existing software defect prediction methods is to attain low classification error rates. These proposals suffer from two practical problems: (i) Most of the prediction methods rely on a large number of labeled training data. However, collecting labeled data is a difficult and expensive task. It is hard to obtain classification labels over new software projects or existing projects without historical defect data. (ii) Software defect datasets are highly imbalanced. In many real-world applications, the misclassification cost of defective modules is generally several times higher than that of non-defective ones. In this paper, we present a misclassification Cost-sensitive approach to Software Defect Prediction (CSDP). The CSDP approach is novel in two aspects: First, CSDP addresses the problem of unlabeled software detect datasets by combining an unsupervised sampling method with a domain specific misclassification cost model. This preprocessing step selectively samples a small percentage of modules through estimating their classification labels. Second, CSDP builds a cost-sensitive support vector machine model to predict defect-proneness of the rest of modules with both overall classification error rate and domain specific misclassification cost as quality metrics. CSDP is evaluated on four NASA projects. Experimental results highlight three interesting observations: (1) CSDP achieves higher Normalized Expected Cost of Misclassification (NECM) compared with state-of-art supervised learning models under imbalanced training data with limited labeling. (2) CSDP outperforms state-of-art semi-supervised learning methods, which disregards classification costs, especially in recall rate. (3) CSDP enhanced through unsupervised sampling as a preprocessing step prior to training and prediction outperforms the baseline CSDP without the sampling process.

Research of software fault prediction based on PU learning

An Improved Semi-Supervised Learning Method for Software Defect Prediction.

Software defect prediction using semi-supervised support vector machine with sampling

An unsupervised defect prediction method based on probability

Positive and unlabeled learning based on random forest

UDA-DP: Unsupervised Domain Adaptation for Software Defect Prediction

Empirical Study on Software Bug Prediction

Software Defect Prediction Method Based on Hybrid Sampling

A systematic review of unsupervised learning techniques for software defect prediction

Predicting Software Black-Box Defects Using Stacked Generalization

Sample-based Software Defect Prediction with Active and Semi-Supervised Learning.

Defect Prediction on Unlabeled Datasets by Using Unsupervised Clustering

The Empirical Study of Semi-Supervised Deep Fuzzy C-Mean Clustering for Software Fault Prediction

Positive-Unlabeled Learning-Based Hybrid Deep Network for Intelligent Fault Detection

Software Defect Prediction and Localization with Attention-Based Models and Ensemble Learning

A Two-Stage Data Preprocessing Approach for Software Fault Prediction

classification Cost-Sensitive Software Defect Prediction

Misclassification Cost-Sensitive Software Defect Prediction

High-fidelity Positive-Unlabeled Deep Learning for Semi-Supervised Fault Detection of Chemical Processes

Tackling Class Overlap and Imbalance Problems in Software Defect Prediction

An Improved Supervised Learning Defect Prediction Model Based on Cat Swarm Algorithm