Abstract:Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models. Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models.

Inverse Weight-Balancing for Deep Long-Tailed Learning

Improving the Accuracy of Learning Example Weights for Imbalance Classification

Adaptive Class-Balanced Loss Based on Re-Weighting

Constructing Balance from Imbalance for Long-Tailed Image Recognition.

Inverse Image Frequency for Long-tailed Image Recognition

Towards Deeper Insights into Deep Learning from Imbalanced Data.

Incremental Weighted Ensemble Broad Learning System for Imbalanced Data

Long-Tailed Recognition via Weight Balancing

To Balance or Not to Balance: A Simple-yet-Effective Approach for Learning with Long-Tailed Distributions

Difficulty-aware Balancing Margin Loss for Long-tailed Recognition

Improving Long-Tail Classification Via Decoupling and Regularisation

M-Weighted Extreme Learning Machine for Imbalanced Learning

Margin-Aware Adaptive-Weighted-Loss for deep learning based imbalanced data classification

BAW: Learning from Class Imbalance and Noisy Labels with Batch Adaptation Weighted Loss.

AREA: Adaptive Reweighting Via Effective Area for Long-Tailed Classification

Deep Weighted Extreme Learning Machine

Phased progressive learning with coupling-regulation-imbalance loss for imbalanced data classification

BBW: a Batch Balance Wrapper for Training Deep Neural Networks on Extremely Imbalanced Datasets with Few Minority Samples

Artificial Bee Colony Optimization-Based Weighted Extreme Learning Machine for Imbalanced Data Learning

Adaptive Weight Optimization for Classification of Imbalanced Data.

Investigating the Sample Weighting Mechanism Using an Interpretable Weighting Framework