Abstract:As one of the supervised learning techniques, classification plays a crucial role in categorizing and predicting the observations across a wide range of machine learning applications such as software defect detection, fraud detection in financial sector, fault and defect detection in manufacturing industry, medical diagnosis, etc. However, most classification algorithms have been developed with the assumption that the class distribution is balanced although unequal class distributions are quite common in many practical cases. When a class imbalance problem exists, in general, the classifier tends to become biased towards the majority class and thus the minority class instances are often misclassified to the majority class. Along with the class imbalance problem, the class overlap is also known as one of the sources that makes the learning task become difficult or sometimes deteriorates the classification performance, especially, when class imbalance problem also exists. Thus, in this research, we propose a cluster impurity-based hybrid resampling method including the partially balanced strategy to improve the classification performance of class imbalanced data with considering intra-cluster class imbalance and inter-cluster overlap problems. Specifically, several clustering methods are employed for identifying the groups (i.e., clusters) of all the instances and the cluster impurity of each instance is computed for measuring the degree of cluster overlap. Then, based on the cluster impurity, the instances are generated and eliminated recursively. To demonstrate the effectiveness of the proposed method, comprehensive experiments are conducted on forty imbalanced datasets and two non-parametric hypothesis tests are employed to show the statistical difference in classification performances between the proposed method and other traditional resampling methods.

Noise-robust Oversampling for Imbalanced Data Classification

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Noise is the Fatal Poison: A Noise-aware Network for Noisy Dataset Classification

Constrained Oversampling: An Oversampling Approach to Reduce Noise Generation in Imbalanced Datasets With Class Overlapping

A Normal Distribution-Based Over-Sampling Approach to Imbalanced Data Classification

Natural local density-based adaptive oversampling algorithm for imbalanced classification

Noise-free sampling with majority framework for an imbalanced classification problem

Learning with Imbalanced Noisy Data by Preventing Bias in Sample Selection

A New Sampling Approach for Classification of Imbalanced Data Sets with High Density.

Weakly Supervised-Based Oversampling for High Imbalance and High Dimensionality Data Classification

An adaptive over-sampling method for imbalanced data based on simultaneous clustering and filtering noisy

Combined Cleaning and Resampling algorithm for multi-class imbalanced data with label noise

A Density-based Under-sampling Algorithm for Imbalance Classification

A cluster impurity-based hybrid resampling for imbalanced classification problems

Gaussian Distribution Based Oversampling for Imbalanced Data Classification

A hybrid sampling method for highly imbalanced and overlapped data classification with complex distribution

Improved Randomized Learning Algorithms for Imbalanced and Noisy Educational Data Classification

Over-sampling algorithm for imbalanced data classification

Improved Oversampling Algorithm for Imbalanced Data Based on K-Nearest Neighbor and Interpolation Process Optimization