Abstract:Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models. Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models.

A neural network learning algorithm for highly imbalanced data classification

Neural Networks Learn Specified Information for Imbalanced Data Classification

Neural Network with a Preference Sampling Paradigm for Imbalanced Data Classification.

Neural Network with Absent Minority Class Samples and Boundary Shifting for Imbalanced Data Classification

Towards Deeper Insights into Deep Learning from Imbalanced Data.

High-Performance Machine Learning for Large-Scale Data Classification Considering Class Imbalance

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

Neural Network Ensemble With Evolutionary Algorithm for Highly Imbalanced Classification

A Novel SMOTE-Based Classification Approach to Online Data Imbalance Problem

Survey on deep learning with class imbalance

A New Approach for Imbalanced Data Classification Based on Minimize Loss Learning

A Novel Cost Sensitive Neural Network Ensemble for Multiclass Imbalance Data Learning

Gradient Harmonized Loss: Improving the Performance of Intelligent Diagnosis Models in Large Imbalance Scenarios.

Simplifying Neural Network Training Under Class Imbalance

Adaptive Class-Balanced Loss Based on Re-Weighting

Phased progressive learning with coupling-regulation-imbalance loss for imbalanced data classification

Improved Randomized Learning Algorithms for Imbalanced and Noisy Educational Data Classification

Procrustean Training for Imbalanced Deep Learning

A Survey on Imbalanced Data Learning Method

Neural Collapse Inspired Attraction-Repulsion-Balanced Loss for Imbalanced Learning

Tackling the Imbalance for GNNs