Abstract:Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models. Deep convolutional neural networks often perform poorly when faced with datasets that suffer from quantity imbalances and classification difficulties. Despite advances in the field, existing two-stage approaches still exhibit dataset bias or domain shift. To counter this, a phased progressive learning schedule has been proposed that gradually shifts the emphasis from representation learning to training the upper classifier. This approach is particularly beneficial for datasets with larger imbalances or fewer samples. Another new method a coupling-regulation-imbalance loss function is proposed, which combines three parts: a correction term, focal loss, and LDAM loss. This loss is effective in addressing quantity imbalances and outliers, while regulating the focus of attention on samples with varying classification difficulties. These approaches have yielded satisfactory results on several benchmark datasets, including Imbalanced CIFAR10, Imbalanced CIFAR100, ImageNet-LT, and iNaturalist 2018, and can be easily generalized to other imbalanced classification models.

Balance-batch: An Optimized Method for Semantic Segmentation Loss Functions

Harmonizing Output Imbalance for semantic segmentation on extremely-imbalanced input data

Contour-weighted loss for class-imbalanced image segmentation

AutoBalance: Optimized Loss Functions for Imbalanced Data

Subclassified Loss: Rethinking Data Imbalance from Subclass Perspective for Semantic Segmentation

Rethinking Dice Loss for Medical Image Segmentation.

Dice Semimetric Losses: Optimizing the Dice Score with Soft Labels

Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations

Optimizing the Dice Score and Jaccard Index for Medical Image Segmentation: Theory & Practice

Striking the Right Balance: Recall Loss for Semantic Segmentation

Unified Focal loss: Generalising Dice and cross entropy-based losses to handle class imbalanced medical image segmentation

AHU-MultiNet: Adaptive loss balancing based on homoscedastic uncertainty in multi-task medical image segmentation network

Batching Soft IoU for Training Semantic Segmentation Networks

Adaptive Real-Time Multi-Loss Function Optimization Using Dynamic Memory Fusion Framework: A Case Study on Breast Cancer Segmentation

Batch-balanced focal loss: a hybrid solution to class imbalance in deep learning

Dilated Balanced Cross Entropy Loss for Medical Image Segmentation

Balanced Loss Function for Accurate Surface Defect Segmentation

Combo Loss: Handling Input and Output Imbalance in Multi-Organ Segmentation

Loss odyssey in medical image segmentation

blob loss: instance imbalance aware loss functions for semantic segmentation

Phased progressive learning with coupling-regulation-imbalance loss for imbalanced data classification