Abstract:Imbalanced data poses a significant challenge in machine learning, as conventional classification algorithms often prioritize majority class samples, while accurately classifying minority class samples is more crucial. The synthetic minority oversampling technique (SMOTE) represents one of the most renowned methods for handling imbalanced data. However, both SMOTE and its variants have limitations due to their insufficient consideration of data distribution, leading to the generation of incorrect and unnecessary samples. This paper, therefore, introduces a novel oversampling algorithm called data distribution and spectral clustering-based SMOTE (DDSC-SMOTE). This algorithm addresses the shortcomings of SMOTE by introducing three innovative data distribution-based improvement strategies: adaptive allocation of synthetic sample quantities strategy, seed sample adaptive selection strategy, and synthetic sample improvement strategy. First, we use the k -nearest neighbor sample labels and the local outlier factor algorithm to remove noisy and outlier samples. Next, we leverage spectral clustering to identify clusters within the minority class and propose a dual-weight factor that considers inter-cluster and intra-cluster distances to allocate the number of synthetic samples effectively, addressing interclass and intraclass imbalances. Furthermore, we introduce a relative position weight coefficient to determine the probability of selecting seed samples within the subcluster, ensuring that important minority samples have higher chances of being sampled. Finally, we improve the SMOTE sample synthesis formula for safer generation. Extensive comparisons on real datasets from the UCI repository demonstrate that DDSC-SMOTE outperforms seven state-of-the-art oversampling algorithms significantly in terms of G -mean and F 1-score, presenting a data distribution-focused solution for addressing imbalanced data challenges.

SMOTE-RkNN: A hybrid re-sampling method based on SMOTE and reverse k-nearest neighbors

SMOTE-kTLNN: A Hybrid Re-Sampling Method Based on SMOTE and a Two-Layer Nearest Neighbor Classifier.

Grouped SMOTE with Noise Filtering Mechanism for Classifying Imbalanced Data.

A Novel Oversampling Technique for Class-Imbalanced Learning Based on SMOTE and Natural Neighbors

Re-Smote: A Novel Imbalanced Sampling Method Based on Smote with Radius Estimation

A Novel SMOTE-Based Classification Approach to Online Data Imbalance Problem

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Synthetic minority oversampling technique based on natural neighborhood graph with subgraph cores for class-imbalanced classification

ExNN-SMOTE - Extended Natural Neighbors Based SMOTE to Deal with Imbalanced Data.

A Novel Hybrid Sampling Framework for Imbalanced Learning

Oversampling for Imbalanced Learning Based on K-Means and SMOTE

Over-sampling algorithm for imbalanced data classification

Two Novel SMOTE Methods for Solving Imbalanced Classification Problems.

WRND: A Weighted Oversampling Framework with Relative Neighborhood Density for Imbalanced Noisy Classification

ASN-SMOTE: a Synthetic Minority Oversampling Method with Adaptive Qualified Synthesizer Selection

A Synthetic Minority Oversampling Technique Based on Gaussian Mixture Model Filtering for Imbalanced Data Classification

SMOTE-WENN: Solving class imbalance and small sample problems by oversampling and distance scaling

Importance-SMOTE: a Synthetic Minority Oversampling Method for Noisy Imbalanced Data

DDSC-SMOTE: an imbalanced data oversampling algorithm based on data distribution and spectral clustering

OALDPC: Oversampling Approach Based on Local Density Peaks Clustering for Imbalanced Classification

Learning class-imbalanced data with region-impurity synthetic minority oversampling technique