Abstract:As one of the supervised learning techniques, classification plays a crucial role in categorizing and predicting the observations across a wide range of machine learning applications such as software defect detection, fraud detection in financial sector, fault and defect detection in manufacturing industry, medical diagnosis, etc. However, most classification algorithms have been developed with the assumption that the class distribution is balanced although unequal class distributions are quite common in many practical cases. When a class imbalance problem exists, in general, the classifier tends to become biased towards the majority class and thus the minority class instances are often misclassified to the majority class. Along with the class imbalance problem, the class overlap is also known as one of the sources that makes the learning task become difficult or sometimes deteriorates the classification performance, especially, when class imbalance problem also exists. Thus, in this research, we propose a cluster impurity-based hybrid resampling method including the partially balanced strategy to improve the classification performance of class imbalanced data with considering intra-cluster class imbalance and inter-cluster overlap problems. Specifically, several clustering methods are employed for identifying the groups (i.e., clusters) of all the instances and the cluster impurity of each instance is computed for measuring the degree of cluster overlap. Then, based on the cluster impurity, the instances are generated and eliminated recursively. To demonstrate the effectiveness of the proposed method, comprehensive experiments are conducted on forty imbalanced datasets and two non-parametric hypothesis tests are employed to show the statistical difference in classification performances between the proposed method and other traditional resampling methods.

Imbalanced Data Classification Based on Hybrid Methods

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

Hybrid SVM algorithm oriented to classifying imbalanced datasets

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

A weighted hybrid ensemble method for classifying imbalanced data

A hybrid ensemble and evolutionary algorithm for imbalanced classification and its application on bioinformatics

A Normal Distribution-Based Over-Sampling Approach to Imbalanced Data Classification

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

A cluster impurity-based hybrid resampling for imbalanced classification problems

An ensemble imbalanced classification method based on model dynamic selection driven by data partition hybrid sampling

Detecting representative data and generating synthetic samples to improve learning accuracy with imbalanced data sets

A Survey of Methods for Managing the Classification and Solution of Data Imbalance Problem

A hybrid imbalanced classification model based on data density

Hybrid approaches for handling imbalanced structured and unstructured data

A Novel Ensemble Method for Classifying Imbalanced Data

A hybrid sampling method for highly imbalanced and overlapped data classification with complex distribution

Towards Deeper Insights into Deep Learning from Imbalanced Data.

An Imbalanced Data Classification Method Based on Automatic Clustering Under-Sampling

Review of Classification Methods on Unbalanced Data Sets