Abstract:In practical applications, imbalanced datasets significantly degrade the classification performance of machine learning models. However, most conventional resampling approaches fall short in adequately addressing the varying contributions of individual features to the classification model. In response to this defect, this study introduces three novel resampling approaches. The first approach, Oversampling based on class instance density per feature value intervals (OCF), focuses on augmenting the dataset. The second approach, Undersampling based on class instance density per feature value intervals (UCF), seeks to reduce dataset size. The third approach, Hybrid sampling based on class instance density per feature value intervals (HSCF), which can perform oversampling and undersampling simultaneously. These approaches categorize feature value into different intervals based on their varying information content, calculate class instance densities within these intervals, and generate feature values in intervals with high discriminative information. Subsequently, these generated features are combined to synthesize minority class data, effectively achieving oversampling. Additionally, the study combines class instance density and feature importance to identify majority class data at the classification boundary with minimal contribution and subsequently executes undersampling. The flexibility to adjust sampling ratios and the integration of OCF and UCF enable the implementation of hybrid sampling. Finally, experiments on the benchmark dataset demonstrate the superiority and effectiveness of the proposed method. Furthermore, it is observed that the method proposed in this study enhances the feature dividing capability of decision tree classifiers. Hence, the best results are achieved when working in synergy with decision tree classifiers, leading to the most significant improvements in classification performance. All codes have been published at https://github.com/Wangfeiopen/HS CF .

A Density-based Under-sampling Algorithm for Imbalance Classification

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

A Normal Distribution-Based Over-Sampling Approach to Imbalanced Data Classification

An Imbalanced Data Classification Method Based on Automatic Clustering Under-Sampling

Over-sampling algorithm for imbalanced data classification

Towards Deeper Insights into Deep Learning from Imbalanced Data.

Resampling approach for imbalanced data classification based on class instance density per feature value intervals

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Nearest neighbors and density-based undersampling for imbalanced data classification with class overlap

Natural local density-based adaptive oversampling algorithm for imbalanced classification

Under-sampling class imbalanced datasets by combining clustering analysis and instance selection

Improved SVM algorithm for imbalanced dataset classification

Noise-robust Oversampling for Imbalanced Data Classification

A Diversity-Based Synthetic Oversampling Using Clustering for Handling Extreme Imbalance

A hybrid ensemble and evolutionary algorithm for imbalanced classification and its application on bioinformatics

Entropy-based Sampling Approaches for Multi-Class Imbalanced Problems

A Synthetic Minority Oversampling Method Based on Local Densities in Low-Dimensional Space for Imbalanced Learning.

Detecting representative data and generating synthetic samples to improve learning accuracy with imbalanced data sets

A majority affiliation based under-sampling method for class imbalance problem