Abstract:In predictive tasks, real-world datasets often present different degrees of imbalanced (i.e., long-tailed or skewed) distributions. While the majority (the head) classes have sufficient samples, the minority (the tail) classes can be under-represented by a rather limited number of samples. Data pre-processing has been shown to be very effective in dealing with such problems. On one hand, data re-sampling is a common approach to tackling class imbalance. On the other hand, dimension reduction, which reduces the feature space, is a conventional technique for reducing noise and inconsistencies in a dataset. However, the possible synergy between feature selection and data re-sampling for high-performance imbalance classification has rarely been investigated before. To address this issue, we carry out a comprehensive empirical study on the joint influence of feature selection and re-sampling on two-class imbalance classification. Specifically, we study the performance of two opposite pipelines for imbalance classification by applying feature selection before or after data re-sampling. We conduct a large number of experiments, with a total of 9225 tests, on 52 publicly available datasets, using 9 feature selection methods, 6 re-sampling approaches for class imbalance learning, and 3 well-known classification algorithms. Experimental results show that there is no constant winner between the two pipelines; thus both of them should be considered to derive the best performing model for imbalance classification. We find that the performance of an imbalance classification model not only depends on the classifier adopted and the ratio between the number of majority and minority samples, but also depends on the ratio between the number of samples and features. Overall, this study should provide new reference value for researchers and practitioners in imbalance learning.

Research on Classification Method of High-Dimensional Class-Imbalanced Data Sets Based on SVM

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

An Unbalanced Dataset Classification Approach Based On V-Support Vector Machine

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Instance Importance Based SVM for Solving Imbalanced Data Classification

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Improved SVM algorithm for imbalanced dataset classification

Improving SVM Classification with Imbalance Data Set

A Study of Data Pre-processing Techniques for Imbalanced Biomedical Data Classification

Mining Knowledge from Unbalanced Data: Effect of Class Distribution on SVM Classification

An Empirical Study on the Joint Impact of Feature Selection and Data Re-sampling on Imbalance Classification

Methods for Class-Imbalanced Learning with Support Vector Machines: A Review and an Empirical Evaluation

Deep Learning-Based Imbalanced Classification With Fuzzy Support Vector Machine

Adaptive Subspace Optimization Ensemble Method for High-Dimensional Imbalanced Data Classification

A broad review on class imbalance learning techniques

An evolutionary algorithm‐based classification method for high‐dimensional imbalanced mixed data with missing information

An Empirical Study on the Joint Impact of Feature Selection and Data Resampling on Imbalance Classification

A Spectral-Spatial Feature Rotation based Ensemble Method for Imbalanced Hyperspectral Image Classification