Abstract:In class imbalance learning problems, how to better recognize examples from the minority class is the key focus, since it is usually more important and expensive than the majority class. Quite a few ensemble solutions have been proposed in the literature with varying degrees of success. It is generally believed that diversity in an ensemble could help to improve the performance of class imbalance learning. However, no study has actually investigated diversity in depth in terms of its definitions and effects in the context of class imbalance learning. It is unclear whether diversity will have a similar or different impact on the performance of minority and majority classes. In this paper, we aim to gain a deeper understanding of if and when ensemble diversity has a positive impact on the classification of imbalanced data sets. First, we explain when and why diversity measured by Q-statistic can bring improved overall accuracy based on two classification patterns proposed by Kuncheva et al. We define and give insights into good and bad patterns in imbalanced scenarios. Then, the pattern analysis is extended to single-class performance measures, including recall, precision, and F-measure, which are widely used in class imbalance learning. Six different situations of diversity's impact on these measures are obtained through theoretical analysis. Finally, to further understand how diversity affects the single class performance and overall performance in class imbalance problems, we carry out extensive experimental studies on both artificial data sets and real-world benchmarks with highly skewed class distributions. We find strong correlations between diversity and discussed performance measures. Diversity shows a positive impact on the minority class in general. It is also beneficial to the overall performance in terms of AUC and G-mean.

On the Relationships among Various Diversity Measures in Multiple Classifier Systems

An Analysis of Diversity Measures

Diversity Measures in Ensemble Learning

Diversity measure for multiple classifier systems

Classifier Ensemble with Diversity：Effectiveness Analysis and Ensemble Optimization

A New Diversity Measure for Classifier Fusion

Integration of Classifier Diversity Measures for Feature Selection-Based Classifier Ensemble Reduction.

A Novel Diversity Measure of Multiple Classifier Systems Based on Distance of Evidence

Relationships Between Diversity of Classification Ensembles and Single-Class Performance Measures.

On the Diversity-Performance Relationship for Majority Voting in Classifier Ensembles.

An Updatable Classifier Diversity Measure Based on the ER Rule

A Novel Diversity Measure Based on Geometrical Relationship

An Ensemble Classifier Based on Attribute Selection and Diversity Measure

A novel classifier ensemble method with sparsity and diversity

Theoretical Study of the Relationship between Diversity and Single-Class Measures for Class Imbalance Learning

Learning to Diversify via Weighted Kernels for Classifier Ensemble

A novel ensemble classifier based on multiple diverse classification methods

When does Diversity Help Generalization in Classification Ensembles?

Learning to Diversify for Ensembling of An Amount of Classifiers

Structural Diversity for Decision Tree Ensemble Learning

Investigation on Diversity in Homogeneous and Heterogeneous Ensembles