Abstract:In predictive tasks, real-world datasets often present different degrees of imbalanced (i.e., long-tailed or skewed) distributions. While the majority (the head) classes have sufficient samples, the minority (the tail) classes can be under-represented by a rather limited number of samples. Data pre-processing has been shown to be very effective in dealing with such problems. On one hand, data re-sampling is a common approach to tackling class imbalance. On the other hand, dimension reduction, which reduces the feature space, is a conventional technique for reducing noise and inconsistencies in a dataset. However, the possible synergy between feature selection and data re-sampling for high-performance imbalance classification has rarely been investigated before. To address this issue, we carry out a comprehensive empirical study on the joint influence of feature selection and re-sampling on two-class imbalance classification. Specifically, we study the performance of two opposite pipelines for imbalance classification by applying feature selection before or after data re-sampling. We conduct a large number of experiments, with a total of 9225 tests, on 52 publicly available datasets, using 9 feature selection methods, 6 re-sampling approaches for class imbalance learning, and 3 well-known classification algorithms. Experimental results show that there is no constant winner between the two pipelines; thus both of them should be considered to derive the best performing model for imbalance classification. We find that the performance of an imbalance classification model not only depends on the classifier adopted and the ratio between the number of majority and minority samples, but also depends on the ratio between the number of samples and features. Overall, this study should provide new reference value for researchers and practitioners in imbalance learning.

Processing imbalanced medical data at the data level with assisted-reproduction data as an example

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Class Weights Random Forest Algorithm for Processing Class Imbalanced Medical Data

Imbalanced Data Classification:A Survey and Experiments in Medical Domain

A Study of Data Pre-processing Techniques for Imbalanced Biomedical Data Classification

Handling imbalanced medical datasets: review of a decade of research

Detecting representative data and generating synthetic samples to improve learning accuracy with imbalanced data sets

A review on over-sampling techniques in classification of multi-class imbalanced datasets: insights for medical problems

Towards Deeper Insights into Deep Learning from Imbalanced Data.

Handling Imbalanced Data: A Case Study for Binary Class Problems

A learning method for the class imbalance problem with medical data sets

Addressing Class Imbalance in Healthcare Data: Machine Learning Solutions for Age-Related Macular Degeneration and Preeclampsia

An Empirical Study on the Joint Impact of Feature Selection and Data Re-sampling on Imbalance Classification

Overlap-Based Undersampling Method for Classification of Imbalanced Medical Datasets

Selecting the Suitable Resampling Strategy for Imbalanced Data Classification Regarding Dataset Properties. An Approach Based on Association Models

Affine combination‐based over‐sampling for imbalanced regression

Imbalanced data preprocessing techniques utilizing local data characteristics

Iterative Online Image Synthesis via Diffusion Model for Imbalanced Classification

Addressing Binary Classification over Class Imbalanced Clinical Datasets Using Computationally Intelligent Techniques

Learning from Imbalanced Data: Integration of Advanced Resampling Techniques and Machine Learning Models for Enhanced Cancer Diagnosis and Prognosis

An empirical evaluation of imbalanced data strategies from a practitioner's point of view