Abstract:Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models. Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models.

Balanced self-paced learning with feature corruption

Weighted Self-Paced Learning with Belief Functions

Self-Paced Boost Learning for Classification.

Self-paced Learning with Diversity

What Objective Does Self-paced Learning Indeed Optimize?

SPLBoost: An Improved Robust Boosting Algorithm Based on Self-Paced Learning

Learning with Imbalanced Noisy Data by Preventing Bias in Sample Selection

A Theoretical Understanding of Self-Paced Learning

Adversarial Learning from Imbalanced Data: A Robust Industrial Fault Classification Method

Adaptive Dropout Rates for Learning with Corrupted Features

Why Curriculum Learning & Self-Paced Learning Work in Big/noisy Data: A Theoretical Perspective

Self-paced Resistance Learning against Overfitting on Noisy Labels

Phased progressive learning with coupling-regulation-imbalance loss for imbalanced data classification

Robust Softmax Regression for Multi-class Classification with Self-Paced Learning.

Confidence-Aware Paced-Curriculum Learning by Label Smoothing for Surgical Scene Understanding

Self-Paced Balance Learning for Clinical Skin Disease Recognition

Evaluating and Enhancing the Robustness of Federated Learning System Against Realistic Data Corruption

Efficient and Robust Deep Learning with Correntropy-induced Loss Function

Balanced Self-Paced Learning for AUC Maximization

Boosting Adversarial Robustness Via Self-Paced Adversarial Training.