Abstract:As one of the supervised learning techniques, classification plays a crucial role in categorizing and predicting the observations across a wide range of machine learning applications such as software defect detection, fraud detection in financial sector, fault and defect detection in manufacturing industry, medical diagnosis, etc. However, most classification algorithms have been developed with the assumption that the class distribution is balanced although unequal class distributions are quite common in many practical cases. When a class imbalance problem exists, in general, the classifier tends to become biased towards the majority class and thus the minority class instances are often misclassified to the majority class. Along with the class imbalance problem, the class overlap is also known as one of the sources that makes the learning task become difficult or sometimes deteriorates the classification performance, especially, when class imbalance problem also exists. Thus, in this research, we propose a cluster impurity-based hybrid resampling method including the partially balanced strategy to improve the classification performance of class imbalanced data with considering intra-cluster class imbalance and inter-cluster overlap problems. Specifically, several clustering methods are employed for identifying the groups (i.e., clusters) of all the instances and the cluster impurity of each instance is computed for measuring the degree of cluster overlap. Then, based on the cluster impurity, the instances are generated and eliminated recursively. To demonstrate the effectiveness of the proposed method, comprehensive experiments are conducted on forty imbalanced datasets and two non-parametric hypothesis tests are employed to show the statistical difference in classification performances between the proposed method and other traditional resampling methods.

Classification for Imbalanced and Overlapping Classes Using Outlier Detection and Sampling Techniques

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

A New Sampling Approach for Classification of Imbalanced Data Sets with High Density.

A Normal Distribution-Based Over-Sampling Approach to Imbalanced Data Classification

An Active Under-Sampling Approach for Imbalanced Data Classification

A hybrid sampling method for highly imbalanced and overlapped data classification with complex distribution

Noise-robust Oversampling for Imbalanced Data Classification

Noise-free sampling with majority framework for an imbalanced classification problem

An Improving Majority Weighted Minority Oversampling Technique for Imbalanced Classification Problem

A Density-based Under-sampling Algorithm for Imbalance Classification

WENN for Individualized Cleaning in Imbalanced Data

A Classification Method Based on Feature Selection for Imbalanced Data

Gaussian Distribution Based Oversampling for Imbalanced Data Classification

Genetic Programming for Borderline Instance Detection in High-Dimensional Unbalanced Classification

Similar classes latent distribution modelling-based oversampling method for imbalanced image classification

A quantum-based oversampling method for classification of highly imbalanced and overlapped data

A cluster impurity-based hybrid resampling for imbalanced classification problems

Anomaly detection-based undersampling for imbalanced classification problems

Handling Class Imbalance and Overlap with a Hesitation-based Instance Selection Method