Abstract:Conventional detectors suffer from performance degradation when dealing with long-tailed data due to a classification bias towards the majority head categories. In this paper, we contend that the learning bias originates from two factors: 1) the unequal competition arising from the imbalanced distribution of foreground categories, and 2) the lack of sample diversity in tail categories. To tackle these issues, we introduce a unified framework called BAlanced CLassification (BACL), which enables adaptive rectification of inequalities caused by disparities in category distribution and dynamic intensification of sample diversities in a synchronized manner. Specifically, a novel foreground classification balance loss (FCBL) is developed to ameliorate the domination of head categories and shift attention to difficult-to-differentiate categories by introducing pairwise class-aware margins and auto-adjusted weight terms, respectively. This loss prevents the over-suppression of tail categories in the context of unequal competition. Moreover, we propose a dynamic feature hallucination module (FHM), which enhances the representation of tail categories in the feature space by synthesizing hallucinated samples to introduce additional data variances. In this divide-and-conquer approach, BACL sets a new state-of-the-art on the challenging LVIS benchmark with a decoupled training pipeline, surpassing vanilla Faster R-CNN with ResNet-50-FPN by 5.8% AP and 16.1% AP for overall and tail categories. Extensive experiments demonstrate that BACL consistently achieves performance improvements across various datasets with different backbones and architectures. Code and models are available at <a class="link-external link-https" href="https://github.com/Tianhao-Qi/BACL" rel="external noopener nofollow">this https URL</a>.

FGBC: Flexible Graph-Based Balanced Classifier for Class-Imbalanced Semi-Supervised Learning

ABC: Auxiliary Balanced Classifier for Class-imbalanced Semi-supervised Learning

BaCon: Boosting Imbalanced Semi-supervised Learning via Balanced Feature-Level Contrastive Learning

TNCB: Tri-net with Cross-Balanced Pseudo Supervision for Class Imbalanced Medical Image Classification

BMB: Balanced Memory Bank for Imbalanced Semi-supervised Learning

Addressing Class Variable Imbalance in Federated Semi-supervised Learning

Class-Adaptive Threshold for Class Imbalanced Semi-Supervised Learning

OCI-SSL: Open Class-Imbalanced Semi-Supervised Learning with Contrastive Learning

A Survey of Class-Imbalanced Semi-Supervised Learning

Graph-BAS3Net: Boundary-Aware Semi-Supervised Segmentation Network with Bilateral Graph Convolution

DCRP: Class-Aware Feature Diffusion Constraint and Reliable Pseudo-Labeling for Imbalanced Semi-Supervised Learning

Class-Imbalanced Semi-Supervised Learning with Adaptive Thresholding.

GBVSSL: Contrastive Semi-Supervised Learning Based on Generalized Bias-Variance Decomposition

Class Balanced Adaptive Pseudo Labeling for Federated Semi-Supervised Learning

Improving Barely Supervised Learning by Discriminating Unlabeled Samples with Super-Class

Class-Specific Thresholding for Imbalanced Semi-Supervised Learning

CoSSL: Co-Learning of Representation and Classifier for Imbalanced Semi-Supervised Learning

Neural collapse inspired semi-supervised learning with fixed classifier

Class-Aware Contrastive Semi-Supervised Learning

Balanced Classification: A Unified Framework for Long-Tailed Object Detection

Bridge the gap between supervised and unsupervised learning for fine-grained classification