Abstract:Context: Defect prediction is a very meaningful topic, particularly at change-level. Change-level defect prediction, which is also referred as just-in-time defect prediction, could not only ensure software quality in the development process, but also make the developers check and fix the defects in time [1].Objective: Ensemble learning becomes a hot topic in recent years. There have been several studies about applying ensemble learning to defect prediction [2-5]. Traditional ensemble learning approaches only have one layer, i.e., they use ensemble learning once. There are few studies that leverages ensemble learning twice or more. To bridge this research gap, we try to hybridize various ensemble learning methods to see if it will improve the performance of just-in-time defect prediction. In particular, we focus on one way to do this by hybridizing bagging and stacking together and leave other possibly hybridization strategies for future work.Method: In this paper, we propose a two-layer ensemble learning approach TLEL which leverages decision tree and ensemble learning to improve the performance of just-in-time defect prediction. In the inner layer, we combine decision tree and bagging to build a Random Forest model. In the outer layer, we use random under-sampling to train many different Random Forest models and use stacking to ensemble them once more.Results: To evaluate the performance of TLEL, we use two metrics, i.e., cost effectiveness and F1-score. We perform experiments on the datasets from six large open source projects, i.e., Bugzilla, Columba, JDT, Platform, Mozilla, and PostgreSQL, containing a total of 137,417 changes. Also, we compare our approach with three baselines, i.e., Deeper, the approach proposed by us [6], DNC, the approach proposed by Wang et al. [2], and MKEL, the approach proposed by Wang et al. [3]. The experimental results show that on average across the six datasets, TLEL could discover over 70% of the bugs by reviewing only 20% of the lines of code, as compared with about 50% for the baselines. In addition, the F1-scores TLEL can achieve are substantially and statistically significantly higher than those of three baselines across the six datasets.Conclusion: TLEL can achieve a substantial and statistically significant improvement over the state-of-the-art methods, i.e., Deeper, DNC and MKEL. Moreover, TLEL could discover over 70% of the bugs by reviewing only 20% of the lines of code. (C) 2017 Elsevier B.V. All rights reserved.

Aligned Metric Representation Based Balanced Multiset Ensemble Learning for Heterogeneous Defect Prediction

Heterogeneous Defect Prediction with Two-Stage Ensemble Learning

Heterogeneous Defect Prediction Through Joint Metric Selection and Matching

HYDRA: Massively Compositional Model for Cross-Project Defect Prediction

Unsupervised Deep Domain Adaptation for Heterogeneous Defect Prediction

Multi-Source Heterogeneous Kernel Mapping in Software Defect Prediction

Landmark-Based Domain Adaptation and Selective Pseudo-Labeling for Heterogeneous Defect Prediction

On the Multiple Sources and Privacy Preservation Issues for Heterogeneous Defect Prediction

IVKMP: A robust data-driven heterogeneous defect model based on deep representation optimization learning

Revisiting heterogeneous defect prediction methods: How far are we?

Combined Classifier for Cross-Project Defect Prediction: an Extended Empirical Study.

Heterogeneous Cross-Company Defect Prediction by Unified Metric Representation and CCA-based Transfer Learning

Balanced Adversarial Tight Matching for Cross‐Project Defect Prediction

Moving from Cross-Project Defect Prediction to Heterogeneous Defect Prediction: A Partial Replication Study

MBL-CPDP: A Multi-objective Bilevel Method for Cross-Project Defect Prediction via Automated Machine Learning

Conditional Domain Adversarial Adaptation for Heterogeneous Defect Prediction.

Cost-sensitive transfer kernel canonical correlation analysis for heterogeneous defect prediction

Joint Instance and Feature Adaptation for Heterogeneous Defect Prediction

TLEL: A Two-Layer Ensemble Learning Approach for Just-in-time Defect Prediction

MHCPDP: multi-source heterogeneous cross-project defect prediction via multi-source transfer learning and autoencoder

Multi-source Heterogeneous Software Defect Prediction Method