Abstract:Imbalanced data poses a significant challenge in machine learning, as conventional classification algorithms often prioritize majority class samples, while accurately classifying minority class samples is more crucial. The synthetic minority oversampling technique (SMOTE) represents one of the most renowned methods for handling imbalanced data. However, both SMOTE and its variants have limitations due to their insufficient consideration of data distribution, leading to the generation of incorrect and unnecessary samples. This paper, therefore, introduces a novel oversampling algorithm called data distribution and spectral clustering-based SMOTE (DDSC-SMOTE). This algorithm addresses the shortcomings of SMOTE by introducing three innovative data distribution-based improvement strategies: adaptive allocation of synthetic sample quantities strategy, seed sample adaptive selection strategy, and synthetic sample improvement strategy. First, we use the k -nearest neighbor sample labels and the local outlier factor algorithm to remove noisy and outlier samples. Next, we leverage spectral clustering to identify clusters within the minority class and propose a dual-weight factor that considers inter-cluster and intra-cluster distances to allocate the number of synthetic samples effectively, addressing interclass and intraclass imbalances. Furthermore, we introduce a relative position weight coefficient to determine the probability of selecting seed samples within the subcluster, ensuring that important minority samples have higher chances of being sampled. Finally, we improve the SMOTE sample synthesis formula for safer generation. Extensive comparisons on real datasets from the UCI repository demonstrate that DDSC-SMOTE outperforms seven state-of-the-art oversampling algorithms significantly in terms of G -mean and F 1-score, presenting a data distribution-focused solution for addressing imbalanced data challenges.

Minority Sub-Region Estimation-Based Oversampling for Imbalance Learning

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

A Synthetic Minority Oversampling Method Based on Local Densities in Low-Dimensional Space for Imbalanced Learning.

DDSC-SMOTE: an imbalanced data oversampling algorithm based on data distribution and spectral clustering

Oversampling With Reliably Expanding Minority Class Regions for Imbalanced Data Learning

Over-sampling algorithm for imbalanced data classification

Over-sampling Algorithm Based on Preliminary Classification in Imbalanced Data Sets Learning

An Improving Majority Weighted Minority Oversampling Technique for Imbalanced Classification Problem

A Diversity-Based Synthetic Oversampling Using Clustering for Handling Extreme Imbalance

Global Data Distribution Weighted Synthetic Oversampling Technique for Imbalanced Learning

Spectral clustering based oversampling:oversampling taking within class ;imbalance into consideration

Detecting representative data and generating synthetic samples to improve learning accuracy with imbalanced data sets

Exploratory Undersampling for Class-Imbalance Learning

Improved Oversampling Algorithm for Imbalanced Data Based on K-Nearest Neighbor and Interpolation Process Optimization

Minority Oversampling for Imbalanced Time Series Classification

Adaptively weighted three-way decision oversampling: A cluster imbalanced-ratio based approach

Learning class-imbalanced data with region-impurity synthetic minority oversampling technique

A Novel Adaptive Minority Oversampling Technique for Improved Classification in Data Imbalanced Scenarios

Grouping-based Oversampling in Kernel Space for Imbalanced Data Classification

A Density-based Under-sampling Algorithm for Imbalance Classification

SP-SMOTE: A novel space partitioning based synthetic minority oversampling technique