Abstract:Imbalanced datasets classification remains an important domain in machine learning. Conventional supervised learning algorithms tend to be biased towards the majority class when addressing imbalanced datasets, thus providing poor classification results on the minority class. The learning task would become more challenging when there are overlapping and within-imbalance issues in imbalanced datasets, which are often the case and have been proven to play more negative impact on the classification performance than between-class imbalance. In this paper, we propose a novel SVDD (Support Vector Data Description) boundary and DPC (Density Peaks Clustering) clustering technique-based oversampling approach (SVDDDPCO) for handling imbalanced and overlapped data. The proposed approach first utilizes support vector data description (SVDD) model with greater penalty constant for the minority class than the majority class to generate the class boundary, and then identifies those misclassified majority or few minority instances by the boundary as potential overlapped or noisy ones and eliminates them. To address the within-balance issues, density peaks clustering (DPC) is used to cluster the minority instances due to its advantage of accurately identifying sub-clusters with different sizes and densities, which facilitates simultaneously combating between-class and within-class imbalance issues caused by various reasons. The minority instances are assigned with different weights inversely proportional to their local densities and their distances to the boundary and then the size for each identified sub-cluster to be oversampled is adaptively determined according to its own size and the weights of its elements. Such strategy aims to generate more synthetic minority instances for borderline and sparser small sub-clusters which are usually informative to the later learning tasks. Finally, oversampling is performed within each sub-cluster with different sizes to not only counteract the within imbalance but also avoid the generation of any noisy or overlapped synthetic instance. Extensive comparison results on various datasets showed the proposed method achieves statistically significant improvements in classification performance relative to state-of-the-art ones.

Clustering-based incremental learning for imbalanced data classification

Cluster-based majority under-sampling approaches for class imbalance learning

A Fuzzy Consensus Clustering Based Undersampling Approach for Class Imbalanced Learning

An incremental sparse LS-SVM classification method for imbalanced data sets

Learning a Unified Classifier Incrementally via Rebalancing

Dynamic Residual Classifier for Class Incremental Learning

An effective method using clustering-based adaptive decomposition and editing-based diversified oversamping for multi-class imbalanced datasets

SVDD Boundary and DPC Clustering Technique-Based Oversampling Approach for Handling Imbalanced and Overlapped Data

Adaptive Weighted Over-Sampling for Imbalanced Datasets Based on Density Peaks Clustering with Heuristic Filtering

Rethinking Class-Incremental Learning from a Dynamic Imbalanced Learning Perspective

Under-sampling class imbalanced datasets by combining clustering analysis and instance selection

A cluster impurity-based hybrid resampling for imbalanced classification problems

Clustering-based Undersampling with Random over Sampling Examples and Support Vector Machine for Imbalanced Classification of Breast Cancer Diagnosis

Dynamic Clustering Method for Imbalanced Learning Based on AdaBoost

An adaptive over-sampling method for imbalanced data based on simultaneous clustering and filtering noisy

Imbalanced Deep Learning by Minority Class Incremental Rectification

Large Scale Incremental Learning

A Density Weighted Fuzzy Outlier Clustering Approach for Class Imbalanced Learning

Addressing Imbalance for Class Incremental Learning in Medical Image Classification

Incremental Learning Imbalanced Data Streams with Concept Drift: the Dynamic Updated Ensemble Algorithm

DYCUSBoost: Adaboost-Based Imbalanced Learning Using Dynamic Clustering and Undersampling.