Abstract:Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models. Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models.

Covariance-corrected Whitening Alleviates Network Degeneration on Imbalanced Classification

Improving Generalization of Batch Whitening by Convolutional Unit Optimization

Feature Whitening via Gradient Transformation for Improved Convergence

Group Whitening: Balancing Learning Efficiency and Representational Capacity

An Investigation into the Stochasticity of Batch Whitening

An Investigation into Whitening Loss for Self-supervised Learning

Understanding Whitening Loss in Self-supervised Learning

Learning a Unified Classifier Incrementally via Rebalancing

Gradient Reweighting: Towards Imbalanced Class-Incremental Learning

Phased progressive learning with coupling-regulation-imbalance loss for imbalanced data classification

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

Batch covariance neural network for image recognition

Switchable Whitening for Deep Representation Learning

Whitening Consistently Improves Self-Supervised Learning

Discrimination Correction and Balance for Class-Incremental Learning

Synergistic Network Learning and Label Correction for Noise-robust Image Classification

An joint end-to-end framework for learning with noisy labels

NeCa: Network Calibration for Class Incremental Learning.

Decorrelated Batch Normalization

Stochastic Whitening Batch Normalization

The Effect of Whitening Transformation on Pooling Operations in Convolutional Autoencoders