Abstract:Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models. Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models.

Dynamically balancing class losses in imbalanced deep learning

Class-Wise Difficulty-Balanced Loss for Solving Class-Imbalance

Phased progressive learning with coupling-regulation-imbalance loss for imbalanced data classification

Towards Deeper Insights into Deep Learning from Imbalanced Data.

DRFL: Dynamic-Recall Focal Loss for Image Classification and Segmentation

Balance-batch: An Optimized Method for Semantic Segmentation Loss Functions

Imbalanced Research of Deep Belief Network Based on Dynamic Cost Sensitive

AutoBalance: Optimized Loss Functions for Imbalanced Data

Neural Collapse Inspired Attraction-Repulsion-Balanced Loss for Imbalanced Learning

Handling Inter-class and Intra-class Imbalance in Class-imbalanced Learning

An Adaptive Deep Metric Learning Loss Function for Class-Imbalance Learning via Intraclass Diversity and Interclass Distillation

Imbalanced Deep Learning by Minority Class Incremental Rectification

Adaptive Class-Balanced Loss Based on Re-Weighting

A New Approach for Imbalanced Data Classification Based on Minimize Loss Learning

The Balanced Loss Curriculum Learning.

An Adaptive Multi-Class Imbalanced Classification Framework Based on Ensemble Methods and Deep Network

Class-Imbalanced Deep Learning via a Class-Balanced Ensemble

Difficulty-aware Balancing Margin Loss for Long-tailed Recognition

Introducing DeepBalance: Random Deep Belief Network Ensembles to Address Class Imbalance

Dynamic Loss For Robust Learning