Abstract:Context: Software defect number prediction (SDNP) helps allocate limited testing resources by ranking software modules according to the predicted defect numbers. However, the highly skewed distribution of defects greatly degrades the performance of SDNP models by preventing SDNP models from ranking software modules accurately. Objective: This paper introduces a novel subspace hybrid sampling ensemble (SHSE) method based on feature subspace construction, hybrid sampling, and ensemble learning for building high-performance SDNP models. Method: Specifically, we first construct a series of feature subspace to ensure the diversity of base learners. In each of feature subspace, we then use the proposed hybrid sampling method to balance the training subset without losing too much information and introducing lots of noisy data caused by only using undersampling or oversampling techniques. Finally, we train each base learner and combine them by using the proposed weighted ensemble strategy. Experiments are performed on 27 public defect datasets. We compare SHSE with five state-of-the-art resampling-based models and four zero-inflated/hurdle models in terms of the ranking performance measure fault-percentile-average (FPA). To demonstrate the effectiveness of SHSE, two statistical testing methods including Wilcoxon Signed-rank test and Scott–Knott Effect Size Difference test are utilized. Cliff’s δ is also computed for quantifying the difference when there is significant difference between SHSE and each baseline. Results: The experimental results show that SHSE significantly outperforms the baselines and improves the performance over each baseline with as least medium effect size on most datasets. On average, SHSE improves the performance over the resampling-based methods by 8.7% ∼ 14.4% and the zero-inflate/hurdle models by 10.3% ∼ 15.2%. Conclusion: It can be concluded that SHSE is a more promising alternative for software defect number prediction.

Self-Healing Umbrella Sampling: Convergence and efficiency

Eigenvector method for umbrella sampling enables error analysis

Umbrella sampling: a powerful method to sample tails of distributions

Successive Umbrella Sampling

A Unified Approach to Enhanced Sampling

Sampling as optimization in the space of measures: The Langevin dynamics as a composite optimization problem

A Splitting Hamiltonian Monte Carlo Method for Efficient Sampling

Fast sampling from constrained spaces using the Metropolis-adjusted Mirror Langevin algorithm

Adaptive sampling accelerates the hybrid deviational particle simulations

"Parallel-Tempering"-Assisted Hybrid Monte Carlo Algorithm For Bayesian Inference In Dynamical Systems

SHSE: A subspace hybrid sampling ensemble method for software defect number prediction

Convergence of Noise-Free Sampling Algorithms with Regularized Wasserstein Proximals

Buckets Instead of Umbrellas for Enhanced Sampling and Free Energy Calculations

Convergence Analysis of Schr{ö}dinger-F{ö}llmer Sampler Without Convexity

Efficient Importance Sampling for Rare Event Simulation with Applications

Sampling with Adaptive Variance for Multimodal Distributions

A Novel Adaptive Undersampling Framework for Class-Imbalance Fault Detection

Superposition Enhanced Nested Sampling

Do all roads lead to Rome? Convergence issues in umbrella sampling simulations

Convergence Analysis of Schr{\"o}dinger-F{\"o}llmer Sampler without Convexity