Abstract:Balancing training on long-tail data distributions remains a long-standing challenge in deep learning. While methods such as re-weighting and re-sampling help alleviate the imbalance issue, limited sample diversity continues to hinder models from learning robust and generalizable feature representations, particularly for tail classes. In contrast to existing methods, we offer a novel perspective on long-tail learning, inspired by an observation: datasets with finer granularity tend to be less affected by data imbalance. In this paper, we investigate this phenomenon through both quantitative and qualitative studies, showing that increased granularity enhances the generalization of learned features in tail categories. Motivated by these findings, we propose a method to increase dataset granularity through category extrapolation. Specifically, we introduce open-set auxiliary classes that are visually similar to existing ones, aiming to enhance representation learning for both head and tail classes. This forms the core contribution and insight of our approach. To automate the curation of auxiliary data, we leverage large language models (LLMs) as knowledge bases to search for auxiliary categories and retrieve relevant images through web crawling. To prevent the overwhelming presence of auxiliary classes from disrupting training, we introduce a neighbor-silencing loss that encourages the model to focus on class discrimination within the target dataset. During inference, the classifier weights for auxiliary categories are masked out, leaving only the target class weights for use. Extensive experiments and ablation studies on three standard long-tail benchmarks demonstrate the effectiveness of our approach, notably outperforming strong baseline methods that use the same amount of data. The code will be made publicly available.

Coarse-to-fine Knowledge Transfer Based Long-Tailed Classification Via Bilateral-Sampling Network

Cumulative Dual-Branch Network Framework for Long-Tailed Multi-Class Classification

Hierarchical long-tailed classification based on multi-granularity knowledge transfer driven by multi-scale feature fusion

To Balance or Not to Balance: A Simple-yet-Effective Approach for Learning with Long-Tailed Distributions

BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognition

Classification of Long-Tailed Data Based on Bilateral-Branch Generative Network with Time-Supervised Strategy

Hierarchical Convolutional Neural Network with Knowledge Complementation for Long-Tailed Classification

Balanced Classification: A Unified Framework for Long-Tailed Object Detection

Mixed Mutual Transfer for Long-Tailed Image Classification

Long-Tailed Recognition by Hierarchical Rebalancing Dual-Classifier

Bt-Vmf Contrastive and Collaborative Learning for Long-Tailed Visual Recognition

Mitigating Biases in Long-Tailed Recognition Via Semantic-Guided Feature Transfer

Sample-Aware Knowledge Distillation for Long-Tailed Learning

Long-Tailed Learning as Multi-Objective Optimization

Improving Long-Tailed Classification from Instance Level

How Re-sampling Helps for Long-Tail Learning?

Feature Re-Balancing for Long-Tailed Visual Recognition.

Long-Tailed Time Series Classification via Feature Space Rebalancing.

ECS-SC: Long-tailed classification via data augmentation based on easily confused sample selection and combination

Exploring the auxiliary learning for long-tailed visual recognition

Learning from Neighbors: Category Extrapolation for Long-Tail Learning