Abstract:Imbalanced datasets classification remains an important domain in machine learning. Conventional supervised learning algorithms tend to be biased towards the majority class when addressing imbalanced datasets, thus providing poor classification results on the minority class. The learning task would become more challenging when there are overlapping and within-imbalance issues in imbalanced datasets, which are often the case and have been proven to play more negative impact on the classification performance than between-class imbalance. In this paper, we propose a novel SVDD (Support Vector Data Description) boundary and DPC (Density Peaks Clustering) clustering technique-based oversampling approach (SVDDDPCO) for handling imbalanced and overlapped data. The proposed approach first utilizes support vector data description (SVDD) model with greater penalty constant for the minority class than the majority class to generate the class boundary, and then identifies those misclassified majority or few minority instances by the boundary as potential overlapped or noisy ones and eliminates them. To address the within-balance issues, density peaks clustering (DPC) is used to cluster the minority instances due to its advantage of accurately identifying sub-clusters with different sizes and densities, which facilitates simultaneously combating between-class and within-class imbalance issues caused by various reasons. The minority instances are assigned with different weights inversely proportional to their local densities and their distances to the boundary and then the size for each identified sub-cluster to be oversampled is adaptively determined according to its own size and the weights of its elements. Such strategy aims to generate more synthetic minority instances for borderline and sparser small sub-clusters which are usually informative to the later learning tasks. Finally, oversampling is performed within each sub-cluster with different sizes to not only counteract the within imbalance but also avoid the generation of any noisy or overlapped synthetic instance. Extensive comparison results on various datasets showed the proposed method achieves statistically significant improvements in classification performance relative to state-of-the-art ones.

Geometric imbalanced deep learning with feature scaling and boundary sample mining

Towards Deeper Insights into Deep Learning from Imbalanced Data.

Feature Fusion Framework Combining Attention Mechanism and Geometric Information

Deep Learning-Based Imbalanced Classification With Fuzzy Support Vector Machine

Geometric Structural Ensemble Learning for Imbalanced Problems

Borderline-margin loss based deep metric learning framework for imbalanced data

High-Resolution Remote Sensing Imagery Classification Of Imbalanced Data Using Multistage Sampling Method And Deep Neural Networks

Harmonizing Output Imbalance for semantic segmentation on extremely-imbalanced input data

Learning Deep Landmarks for Imbalanced Classification

A Spectral-Spatial-Dependent Global Learning Framework for Insufficient and Imbalanced Hyperspectral Image Classification

DGSSC: A Deep Generative Spectral-Spatial Classifier for Imbalanced Hyperspectral Imagery

Delving into Semantic Scale Imbalance

Unbalanced data processing using deep sparse learning technique

Imbalanced sample feature enhancement of hyperspectral imagery classification

A Novel SMOTE-Based Classification Approach to Online Data Imbalance Problem

Self-paced Ensemble for Highly Imbalanced Massive Data Classification

An improved deep forest for alleviating the data imbalance problem

A MeanShift-guided Oversampling with Self-Adaptive Sizes for Imbalanced Data Classification

An ensemble imbalanced classification method based on model dynamic selection driven by data partition hybrid sampling

SVDD Boundary and DPC Clustering Technique-Based Oversampling Approach for Handling Imbalanced and Overlapped Data

Dynamic self-paced sampling ensemble for highly imbalanced and class-overlapped data classification