Abstract:An oversampling technique balances a dataset by increasing the number of minority samples. It is a common and effective method in imbalanced learning. However, most oversampling methods have randomness in generating minority samples, which would have negative impacts on the prediction performance of subsequent classifiers. This study treats the prediction made by classifiers as a black-box optimization problem. The optimization objective is to improve the classification accuracy of subsequent classifiers for minority samples. The solution of this optimization problem can be regarded as a minority sample that can be and added to the imbalanced dataset. The minority samples are iteratively generated by Bayesian optimization (BO). We determine two valuable intervals for each 1-D continuous variable feature. One is the interval with the densest minority samples. The other is that with the sparsest majority samples distributed among the minority samples. By adjusting the proportion of samples generated in the two areas, the presented algorithm can be flexibly applied to different datasets. In order to reduce the noise that may be caused by the exploration phase of BO, a sample selection procedure is carried out to eliminate the samples that are worse than those generated at the previous iteration. The samples generated in this way are based on the principle of improving the performance of the classifier, thus avoiding the negative effects of randomness. Experimental results via twenty open imbalanced datasets show that the proposed method obtains better results than existing state-of-the-art oversampling models, thus well advancing the important field of imbalanced learning.

Minority-prediction-probability-based Oversampling Technique for Imbalanced Learning

Importance-SMOTE: a Synthetic Minority Oversampling Method for Noisy Imbalanced Data

A Synthetic Minority Oversampling Technique Based on Gaussian Mixture Model Filtering for Imbalanced Data Classification

G-SMOTE: A GMM-based synthetic minority oversampling technique for imbalanced learning.

A Synthetic Minority Oversampling Method Based on Local Densities in Low-Dimensional Space for Imbalanced Learning.

LAD-SMOTE: A New Oversampling Method Based on Locally Adaptive Distance

CMO-SMOTE: Misclassification Cost Minimization Oriented Synthetic Minority Oversampling Technique for Imbalanced Learning

A Novel Adaptive Minority Oversampling Technique for Improved Classification in Data Imbalanced Scenarios

BO-SMOTE: A Novel Bayesian-Optimization-Based Synthetic Minority Oversampling Technique

SP-SMOTE: A novel space partitioning based synthetic minority oversampling technique

Minority Oversampling Using Sensitivity

MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning

ASN-SMOTE: a Synthetic Minority Oversampling Method with Adaptive Qualified Synthesizer Selection

Local Distribution-Based Adaptive Minority Oversampling for Imbalanced Data Classification

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

SMOTE: Synthetic Minority Over-sampling Technique

A No Parameter Synthetic Minority Oversampling Technique Based on Finch for Imbalanced Data.

A Data Mining Method for Imbalanced Datasets Based on One-Sided Link and Distribution Density of Instances

A New Oversampling Method Based on Triangulation of Sample Space

Synthetic minority oversampling technique for multiclass imbalance problems.

PF-SMOTE: A Novel Parameter-Free SMOTE for Imbalanced Datasets