Abstract:SMOTE (Synthetic Minority Oversampling TEchnique) is one of the most popular and well-known sampling algorithms for addressing class imbalance learning problem. The merits of SMOTE reflect at that in comparison with the random oversampling technique, it can alleviate the problem of overfitting to a large extent. However, two drawbacks of SMOTE have also been observed as follows, 1) it tends to propagate the noisy information in the procedure of oversampling; 2) it always assigns a global neighborhood parameter $K$ but neglects the local distribution characteristics. To synchronously deal with these two problems, a grouped SMOTE algorithm with noise filtering mechanism (GSMOTE-NFM) is presented in this article. The algorithm firstly adopts Gaussian-Mixture Model (GMM) to explore the real distributions of the majority and minority classes, respectively. Then, most noisy instances can be removed by comparing the probability densities of the same instance in two different classes. Next, two new GMMs are constructed on the rest majority and minority class instances, respectively. Furthermore, all minority class instances can be divided into three different groups: safety, boundary and outlier, based on the corresponding probability density information. Finally, we assign an individual parameter $K$ to the instances belonging to each specific group to generate new instances. We tested GSMOTE-NFM algorithm on 24 benchmark binary-class data sets with three popular classification models, and compared it with several state-of-the-art oversampling algorithms. The results indicate that our algorithm is significantly superior than the original SMOTE algorithm and several SMOTE-based modified methods.

SMOTEMultiBoost: Leveraging the SMOTE with MultiBoost to Confront the Class Imbalance in Supervised Learning

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Adapting MultiBoost ensemble for class imbalanced learning

Solving the Class Imbalance Problems Using RUSMultiBoost Ensemble

A Novel SMOTE-Based Classification Approach to Online Data Imbalance Problem

A cluster-based SMOTE both-sampling (CSBBoost) ensemble algorithm for classifying imbalanced data

Distribution based ensemble for class imbalance learning

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Two Novel SMOTE Methods for Solving Imbalanced Classification Problems.

Multi-Class Imbalance Problem: A Multi-Objective Solution

CHSMOTE: Convex Hull-Based Synthetic Minority Oversampling Technique for Alleviating the Class Imbalance Problem.

Grouped SMOTE with Noise Filtering Mechanism for Classifying Imbalanced Data.

WOTBoost: Weighted Oversampling Technique in Boosting for imbalanced learning

Oversampling for Imbalanced Learning Based on K-Means and SMOTE

TDMO: Dynamic Multi-Dimensional Oversampling for Exploring Data Distribution Based on Extreme Gradient Boosting Learning.

A Novel Oversampling Technique for Class-Imbalanced Learning Based on SMOTE and Natural Neighbors

Comparing Different Oversampling Methods in Predicting Multi-Class Educational Datasets Using Machine Learning Techniques

SMOTE-WENN: Solving class imbalance and small sample problems by oversampling and distance scaling

A Novel Adaptive Minority Oversampling Technique for Improved Classification in Data Imbalanced Scenarios

Transfer Boosting with Synthetic Instances for Class Imbalanced Object Recognition.

BalancedBoost: A hybrid approach for real-time network traffic classification