Abstract:An oversampling technique balances a dataset by increasing the number of minority samples. It is a common and effective method in imbalanced learning. However, most oversampling methods have randomness in generating minority samples, which would have negative impacts on the prediction performance of subsequent classifiers. This study treats the prediction made by classifiers as a black-box optimization problem. The optimization objective is to improve the classification accuracy of subsequent classifiers for minority samples. The solution of this optimization problem can be regarded as a minority sample that can be and added to the imbalanced dataset. The minority samples are iteratively generated by Bayesian optimization (BO). We determine two valuable intervals for each 1-D continuous variable feature. One is the interval with the densest minority samples. The other is that with the sparsest majority samples distributed among the minority samples. By adjusting the proportion of samples generated in the two areas, the presented algorithm can be flexibly applied to different datasets. In order to reduce the noise that may be caused by the exploration phase of BO, a sample selection procedure is carried out to eliminate the samples that are worse than those generated at the previous iteration. The samples generated in this way are based on the principle of improving the performance of the classifier, thus avoiding the negative effects of randomness. Experimental results via twenty open imbalanced datasets show that the proposed method obtains better results than existing state-of-the-art oversampling models, thus well advancing the important field of imbalanced learning.

CMO-SMOTE: Misclassification Cost Minimization Oriented Synthetic Minority Oversampling Technique for Imbalanced Learning

CSMOTE: Contrastive Synthetic Minority Oversampling for Imbalanced Time Series Classification.

Importance-SMOTE: a Synthetic Minority Oversampling Method for Noisy Imbalanced Data

Minority-prediction-probability-based Oversampling Technique for Imbalanced Learning

SMOTE: Synthetic Minority Over-sampling Technique

A Synthetic Minority Oversampling Technique Based on Gaussian Mixture Model Filtering for Imbalanced Data Classification

G-SMOTE: A GMM-based synthetic minority oversampling technique for imbalanced learning.

CHSMOTE: Convex Hull-Based Synthetic Minority Oversampling Technique for Alleviating the Class Imbalance Problem.

Minority Oversampling Using Sensitivity

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

LAD-SMOTE: A New Oversampling Method Based on Locally Adaptive Distance

A No Parameter Synthetic Minority Oversampling Technique Based on Finch for Imbalanced Data.

A Synthetic Minority Oversampling Method Based on Local Densities in Low-Dimensional Space for Imbalanced Learning.

Over-sampling algorithm for imbalanced data classification

CSMOUTE: Combined Synthetic Oversampling and Undersampling Technique for Imbalanced Data Classification

BO-SMOTE: A Novel Bayesian-Optimization-Based Synthetic Minority Oversampling Technique

ACTIVE LEARNING SMOTE BASED IMBALANCED DATA CLASSIFICATION

Minimum Enclosing Ball Synthetic Minority Oversampling Technique from a Geometric Perspective

SP-SMOTE: A novel space partitioning based synthetic minority oversampling technique

A New Oversampling Method Based on Triangulation of Sample Space

Abstention-Smote: An Over-Sampling Approach For Imbalanced Data Classification