Abstract:Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models. Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models.

Learning Representative Features Via Constrictive Annular Loss for Image Classification

A Loss Combination Based Deep Model for Person Re-Identification

CAM-loss: Towards Learning Spatially Discriminative Feature Representations

Towards Learning Spatially Discriminative Feature Representations

Subdomain contraction in deep networks for robust representation learning

CC-Loss: Channel Correlation Loss For Image Classification

HCFNN: High-order Coverage Function Neural Network for Image Classification

Phased progressive learning with coupling-regulation-imbalance loss for imbalanced data classification

Competing ratio loss for discriminative multi-class image classification

Angular Joint Loss for Image Classification

Multi-stage feature decorrelation constraints for improving CNN classification performance

Improved generalization performance of convolutional neural networks with LossDA

Joint Supervision for Discriminative Feature Learning in Convolutional Neural Networks.

On the Learning Property of Logistic and Softmax Losses for Deep Neural Networks

A CT Image Feature Space (CTIS) Loss for Restoration with Deep Learning-Based Methods

A Novel Loss Function for Optical and SAR Image Matching: Balanced Positive and Negative Samples

Training DCNN by Combining Max-Margin, Max-Correlation Objectives, and Correntropy Loss for Multilabel Image Classification.

Fine-Grained Image Classification Using Modified DCNNs Trained by Cascaded Softmax and Generalized Large-Margin Losses

A Novelty Adversarial Loss for Classifying Unbalanced Anomaly Images

Contrastive Learning Based Hybrid Networks for Long-Tailed Image Classification

Hard Decorrelated Centralized Loss for fine-grained image retrieval