Abstract:Conventional detectors suffer from performance degradation when dealing with long-tailed data due to a classification bias towards the majority head categories. In this paper, we contend that the learning bias originates from two factors: 1) the unequal competition arising from the imbalanced distribution of foreground categories, and 2) the lack of sample diversity in tail categories. To tackle these issues, we introduce a unified framework called BAlanced CLassification (BACL), which enables adaptive rectification of inequalities caused by disparities in category distribution and dynamic intensification of sample diversities in a synchronized manner. Specifically, a novel foreground classification balance loss (FCBL) is developed to ameliorate the domination of head categories and shift attention to difficult-to-differentiate categories by introducing pairwise class-aware margins and auto-adjusted weight terms, respectively. This loss prevents the over-suppression of tail categories in the context of unequal competition. Moreover, we propose a dynamic feature hallucination module (FHM), which enhances the representation of tail categories in the feature space by synthesizing hallucinated samples to introduce additional data variances. In this divide-and-conquer approach, BACL sets a new state-of-the-art on the challenging LVIS benchmark with a decoupled training pipeline, surpassing vanilla Faster R-CNN with ResNet-50-FPN by 5.8% AP and 16.1% AP for overall and tail categories. Extensive experiments demonstrate that BACL consistently achieves performance improvements across various datasets with different backbones and architectures. Code and models are available at <a class="link-external link-https" href="https://github.com/Tianhao-Qi/BACL" rel="external noopener nofollow">this https URL</a>.

Long-Tailed Classification Based on Dual Branch Learning Network

Cumulative Dual-Branch Network Framework for Long-Tailed Multi-Class Classification

A dual-branch model with inter- and intra-branch contrastive loss for long-tailed recognition

Label Distribution Learning-Enhanced Dual-KNN for Text Classification

BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognition

Long-Tailed Recognition by Hierarchical Rebalancing Dual-Classifier

Classification of Long-Tailed Data Based on Bilateral-Branch Generative Network with Time-Supervised Strategy

Dual-branch Branch Networks Based on Contrastive Learning for Long-Tailed Remote Sensing

A Dual-Branch Learning Model with Gradient-Balanced Loss for Long-Tailed Multi-Label Text Classification

Asynchronous Modeling: A Dual-phase Perspective for Long-Tailed Recognition

Balanced Classification: A Unified Framework for Long-Tailed Object Detection

Deep Long-Tailed Learning: A Survey

Decoupling Representation and Classifier for Long-Tailed Recognition

A Deep Learning Model for Long-Tail Visual Recognition

Constructing Balance from Imbalance for Long-Tailed Image Recognition.

A Dual Progressive Strategy for Long-Tailed Visual Recognition

Long-Tailed Recognition of Food Crop Disease Images Based on Deep Neural Networks: Long-Tailed Recognition of Food Crop Disease Images.

SAU: A Dual-Branch Network to Enhance Long-Tailed Recognition via Generative Models

Dual Compensation Residual Networks for Class Imbalanced Learning

Long-Tailed Recognition on Binary Networks by Calibrating A Pre-trained Model

Investigate the Essence of Long-Tailed Recognition from a Unified Perspective