Abstract:Despite the recent success of visual recognition on artificially balanced datasets, the performance degrades heavily in face of the long-tailed distribution. Existing methods typically tackle this problem by re-balancing the distribution in the data space. However, we observe that more balanced data distribution can not effectively alleviate the problem of uneven feature distribution, still leading to a heavily biased classifier. In this paper, we propose a novel re-balancing framework, Feature Re-Balancing (FeatRB), which directly re-balances the distribution in the feature space by combining the long-tailed initial features and the generated virtual features. The key ideas of FeatRB include: 1) Generating the virtual features. First, we calculate the class-wise feature mean and variance based on the past learned representations and store them in a memory bank. Then we generate virtual features based on the memory bank. And to increase the diversity of generated features, we transfer the variance from similar classes to tail classes. 2) Utilizing the generated features. We introduce a simple but effective sampling strategy, Effective Number Reversed Sampling (ENRS), to assign larger sampling probability for tail classes. 3) Updating the memory bank. We propose an updating method, Adaptive Updating (AU), which adaptively updates the memory bank in the training process to further improve the diversity. By increasing the intra-class diversity, FeatRB enlarges the spatial span for the features of tail classes. Therefore, the discriminative power of tail classes can be enhanced, and then the biased classifier can be calibrated. Extensive experiments on three widely used large-scale long-tailed datasets show that our FeatRB surpasses the current state-of-the-art methods.

Feature Distribution Representation Learning Based on Knowledge Transfer for Long-Tailed Classification

Label-Aware Distribution Calibration for Long-tailed Classification

Sample-Aware Knowledge Distillation for Long-Tailed Learning

Relieving the Incompatibility of Network Representation and Classification for Long-Tailed Data Distribution

Transfer Knowledge from Head to Tail: Uncertainty Calibration under Long-tailed Distribution.

Balanced Knowledge Distillation for Long-tailed Learning

Learning from Multiple Experts: Self-paced Knowledge Distillation for Long-tailed Classification

One‐stage self‐distillation guided knowledge transfer for long‐tailed visual recognition

Coarse-to-fine Knowledge Transfer Based Long-Tailed Classification Via Bilateral-Sampling Network

Geometric Prior Guided Feature Representation Learning for Long-Tailed Classification

Long-tailed Diffusion Models with Oriented Calibration

Feature Re-Balancing for Long-Tailed Visual Recognition.

Balanced Self-Distillation for Long-Tailed Recognition

Mitigating Biases in Long-Tailed Recognition Via Semantic-Guided Feature Transfer

Feature Space Augmentation for Long-Tailed Data

Decoupling Representation and Classifier for Long-Tailed Recognition

Active Diversification of Head-Class Features in Bilateral-Expert Models for Enhanced Tail-Class Optimization in Long-Tailed Classification

Hierarchical long-tailed classification based on multi-granularity knowledge transfer driven by multi-scale feature fusion

Knowledge Distillation on Multiple Experts for Long-Tailed Recognition

Mixed Mutual Transfer for Long-Tailed Image Classification