Abstract:Imbalanced data poses a significant challenge in machine learning, as conventional classification algorithms often prioritize majority class samples, while accurately classifying minority class samples is more crucial. The synthetic minority oversampling technique (SMOTE) represents one of the most renowned methods for handling imbalanced data. However, both SMOTE and its variants have limitations due to their insufficient consideration of data distribution, leading to the generation of incorrect and unnecessary samples. This paper, therefore, introduces a novel oversampling algorithm called data distribution and spectral clustering-based SMOTE (DDSC-SMOTE). This algorithm addresses the shortcomings of SMOTE by introducing three innovative data distribution-based improvement strategies: adaptive allocation of synthetic sample quantities strategy, seed sample adaptive selection strategy, and synthetic sample improvement strategy. First, we use the k -nearest neighbor sample labels and the local outlier factor algorithm to remove noisy and outlier samples. Next, we leverage spectral clustering to identify clusters within the minority class and propose a dual-weight factor that considers inter-cluster and intra-cluster distances to allocate the number of synthetic samples effectively, addressing interclass and intraclass imbalances. Furthermore, we introduce a relative position weight coefficient to determine the probability of selecting seed samples within the subcluster, ensuring that important minority samples have higher chances of being sampled. Finally, we improve the SMOTE sample synthesis formula for safer generation. Extensive comparisons on real datasets from the UCI repository demonstrate that DDSC-SMOTE outperforms seven state-of-the-art oversampling algorithms significantly in terms of G -mean and F 1-score, presenting a data distribution-focused solution for addressing imbalanced data challenges.

Research on Expansion and Classification of Imbalanced Data Based on SMOTE Algorithm

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

Classification algorithm for class imbalanced data based on optimized Mahalanobis-Taguchi system

Over-sampling algorithm for imbalanced data classification

A self-inspected adaptive SMOTE algorithm (SASMOTE) for highly imbalanced data classification in healthcare

SMOTE-WENN: Solving class imbalance and small sample problems by oversampling and distance scaling

A cluster-based SMOTE both-sampling (CSBBoost) ensemble algorithm for classifying imbalanced data

An Improved Algorithm for Imbalanced Data and Small Sample Size Classification

Improved SVM algorithm for imbalanced dataset classification

An Over Sampling Method of Unbalanced Data Based on Ant Colony Clustering

Improving SVM Classification with Imbalance Data Set

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

Adaptive over-sampling method for classification with application to imbalanced datasets in aluminum electrolysis

Imbalanced Data Classification:A Survey and Experiments in Medical Domain

PF-SMOTE: A Novel Parameter-Free SMOTE for Imbalanced Datasets

DDSC-SMOTE: an imbalanced data oversampling algorithm based on data distribution and spectral clustering

A Study of Discriminatory Speech Classification Based on Improved Smote and SVM-RF

Imbalanced Data Classification Based on Improved Random-SMOTE and Feature Standard Deviation

A Study of Data Pre-processing Techniques for Imbalanced Biomedical Data Classification