Abstract:Minority oversampling is currently one of the most popular and effective methods for handling imbalanced data. However, oversampling that relies on the observations of the minority class to generate new samples is not applicable in the scenario of imbalanced data with extremely scarce minority samples, because the strongly underrepresented minority class does not contain enough information to support the oversampling process. Since some recent studies have exhibited the effectiveness of using majority information to bootstrap oversampling, the neglect of class overlap in the sampling process would increase the overlapping degree and complicate the decision boundary. To this end, this paper proposes a Mahalanobis distance and Local information based OverSampling (MLOS) for highly imbalanced class-overlapped data. MLOS first employs the majority density to guide the sample synthesis, with Mahalanobis distance to extract the majority probability contour. Then for each minority seed sample, to avoid the generation of overlapping samples, MLOS constrain the synthetic process by finding the auxiliary sample (in its 5 nearest neighbors) with similar probability density value to the seed. Finally, MLOS uses a pair-wise data cleaning process to improve the visibility of the decision boundary according to the probability density of synthetic samples. Comparative experiments conducted on 16 highly imbalanced class-overlapped datasets, using 17 different methods, demonstrates the superiority of our proposed method in terms of three popular evaluation metrics AUC , G - mean and Recall for imbalance classification. The source code of MLOS is available at https://github.com/ytyancp/MLOS .

Gaussian prior based adaptive synthetic sampling with non-linear sample space for imbalanced learning

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

An ensemble oversampling method for imbalanced classification with prior knowledge via generative adversarial network

Effective Sample Synthesizing in Kernel Space for Imbalanced Classification

A Synthetic Minority Oversampling Method Based on Local Densities in Low-Dimensional Space for Imbalanced Learning.

Synthetic Information towards Maximum Posterior Ratio for deep learning on Imbalanced Data

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Improved SVM algorithm for imbalanced dataset classification

A Novel Adaptive Minority Oversampling Technique for Improved Classification in Data Imbalanced Scenarios

Improved Oversampling Algorithm for Imbalanced Data Based on K-Nearest Neighbor and Interpolation Process Optimization

GenSample: A Genetic Algorithm for Oversampling in Imbalanced Datasets

Gaussian Distribution Based Oversampling for Imbalanced Data Classification

A hybrid sampling method for highly imbalanced and overlapped data classification with complex distribution

Generative adversarial minority enlargement—A local linear over-sampling synthetic method

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Variational autoencoder based synthetic data generation for imbalanced learning

Weakly Supervised-Based Oversampling for High Imbalance and High Dimensionality Data Classification

A Normal Distribution-Based Over-Sampling Approach to Imbalanced Data Classification

SORAG: Synthetic Data Over-Sampling Strategy on Multi-Label Graphs

Synthetic oversampling with Mahalanobis distance and local information for highly imbalanced class-overlapped data