Abstract:Imbalanced data classification remains a research hotspot and a challenging problem in the field of machine learning. The challenge of imbalanced learning lies not only in class imbalance problem, but also in the class overlapping problem which is complex. However, most of the existing algorithms mainly focus on the former. The limitation prevents the existing methods from breaking through. To address this limitation, this paper proposes an ensemble algorithm based on dual clustering and stage-wise hybrid sampling (DCSHS) to address both class imbalance and class overlapping problems. The DCSHS has three main parts: projection clustering combination framework (PCC), stage-wise hybrid sampling (SHS) and envelope clustering transfer mapping mechanism (CTM). PCC is to create multiple subsets through projective clustering. SHS is to identify the overlapping region of each subset and conduct hybrid sampling. CTM is to explore more information of samples in each subset by combining the clustering and transfer learning. At first, we design a PCC framework guided by Davies-Bouldin clustering effectiveness index (DBI), which is used to obtain high-quality clusters and combine them to obtain a set of cross-complete subsets (CCS) with low overlapping. Secondly, according to the characteristics of subset classes, a SHS algorithm is designed to realize the de-overlapping and balancing of subsets. Finally, an envelope clustering transfer mapping mechanism (CTM) is constructed for all processed subsets by means of transfer learning, thereby reducing class overlapping and explore structural information of samples. Weak classifiers are trained on the balanced subsets, and fused as all the imbalanced ensemble algorithms did. The major advantage of our algorithm is that it can exploit the intersectionality of the CCS to realize the soft elimination of overlapping majority samples, and learn as much information of overlapping samples as possible, thereby enhancing the class overlapping while class balancing. In the experimental section, more than 30 public datasets and over ten representative algorithms are chosen for verification. The experimental results show that the DCSHS is significantly best in terms of anti-overlapping, Recall, F1-M, G-M, AUC, and diversity.

DYCUSBoost: Adaboost-Based Imbalanced Learning Using Dynamic Clustering and Undersampling.

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

CUSBoost: Cluster-based Under-sampling with Boosting for Imbalanced Classification

An Imbalanced Data Classification Method Based on Automatic Clustering Under-Sampling

Under-sampling class imbalanced datasets by combining clustering analysis and instance selection

Dbboost: Enhancing Imbalanced Classification by A Novel Ensemble Based Technique

A cluster-based SMOTE both-sampling (CSBBoost) ensemble algorithm for classifying imbalanced data

Improved Pso_adaboost Ensemble Algorithm For Imbalanced Data

A Cluster-Based Hybrid Sampling Approach for Imbalanced Data Classification.

LIUBoost : Locality Informed Underboosting for Imbalanced Data Classification

Entropy and Confidence-Based Undersampling Boosting Random Forests for Imbalanced Problems.

EHSBoost: Enhancing ensembles for imbalanced data-sets by evolutionary hybrid-sampling

WOTBoost: Weighted Oversampling Technique in Boosting for imbalanced learning

Sampling + Reweighting: Boosting the Performance of AdaBoost on Imbalanced Datasets

Over-sampling Algorithm Based on Adaboost in Unbalanced Data Set

An Imbalanced Ensemble Learning Method Based on Dual Clustering and Stage-Wise Hybrid Sampling

DDSC-SMOTE: an imbalanced data oversampling algorithm based on data distribution and spectral clustering

A Density-based Under-sampling Algorithm for Imbalance Classification

Dynamic self-paced sampling ensemble for highly imbalanced and class-overlapped data classification

Novel resampling algorithms with maximal cliques for class-imbalance problems