Abstract:In predictive tasks, real-world datasets often present different degrees of imbalanced (i.e., long-tailed or skewed) distributions. While the majority (the head) classes have sufficient samples, the minority (the tail) classes can be under-represented by a rather limited number of samples. Data pre-processing has been shown to be very effective in dealing with such problems. On one hand, data re-sampling is a common approach to tackling class imbalance. On the other hand, dimension reduction, which reduces the feature space, is a conventional technique for reducing noise and inconsistencies in a dataset. However, the possible synergy between feature selection and data re-sampling for high-performance imbalance classification has rarely been investigated before. To address this issue, we carry out a comprehensive empirical study on the joint influence of feature selection and re-sampling on two-class imbalance classification. Specifically, we study the performance of two opposite pipelines for imbalance classification by applying feature selection before or after data re-sampling. We conduct a large number of experiments, with a total of 9225 tests, on 52 publicly available datasets, using 9 feature selection methods, 6 re-sampling approaches for class imbalance learning, and 3 well-known classification algorithms. Experimental results show that there is no constant winner between the two pipelines; thus both of them should be considered to derive the best performing model for imbalance classification. We find that the performance of an imbalance classification model not only depends on the classifier adopted and the ratio between the number of majority and minority samples, but also depends on the ratio between the number of samples and features. Overall, this study should provide new reference value for researchers and practitioners in imbalance learning.

Improving Class Balancing at Both Feature Extractor and Classifier Head

To Balance or Not to Balance: A Simple-yet-Effective Approach for Learning with Long-Tailed Distributions

A Dissimilarity-Based Imbalance Data Classification Algorithm

Class-Imbalance Learning Based Discriminant Analysis

Alleviating Data Imbalance Issue with Perturbed Input During Inference

An Empirical Study on the Joint Impact of Feature Selection and Data Re-sampling on Imbalance Classification

Feature Fusion Framework Combining Attention Mechanism and Geometric Information

Combating the class imbalance problemin sparse representation learning.

Emphasizing feature inter-class separability for improving highly imbalanced overlapped data classification.

Exploring the auxiliary learning for long-tailed visual recognition

Improving imbalance classification via ensemble learning based on two-stage learning

IMBALANCED DATA CLASSIFICATION ACTIVE LEARNING ALGORITHM BASED ON BOOSTING

An Empirical Study on the Joint Impact of Feature Selection and Data Resampling on Imbalance Classification

High-Performance Machine Learning for Large-Scale Data Classification Considering Class Imbalance

Improved Boosting Algorithm for Small and Imbalanced Training Sets

An Adaptive Multi-Class Imbalanced Classification Framework Based on Ensemble Methods and Deep Network

Improving the Accuracy of Learning Example Weights for Imbalance Classification

An effective method using clustering-based adaptive decomposition and editing-based diversified oversamping for multi-class imbalanced datasets

Alleviating Long-Tailed Image Classification via Dynamical Classwise Splitting

To Combat Multiclass Imbalanced Problems by Aggregating Evolutionary Hierarchical Classifiers

Handling Inter-class and Intra-class Imbalance in Class-imbalanced Learning