Abstract:This paper considers deep visual recognition on long-tailed data. Under the long-tailed distribution, a small portion of the classes (head classes) occupy most training samples and the most classes (tail classes) only occupy relatively few samples. We observe that such long-tailed distribution significantly distorts the deeply-learned feature space, which consequentially compromises the deep visual recognition. Specifically, during training, each head class is prone to a relatively wide spatial distribution in the deep feature space, while each tail class is prone to a relatively small spatial distribution. In another word, the tail classes usually have much smaller spatial distribution than the head classes, distorting the overall feature space. In response, we propose to explicitly inflate the distribution of each tail class in the deep feature space, so that the tail classes will have comparable distribution range as the head classes. To this end, we replace each tail feature vector with a set of feature vectors on the fly. These feature vectors follow a probabilistic distribution learned from the head classes and yield a “feature cloud” surrounding the original tail feature. We show that the feature cloud effectively transfers the within-class diversity from the head classes onto the tail classes, maintaining an effect of probabilistic feature augmentation. An important advantage of the proposed feature cloud is that it is capable to bring general improvement to long-tailed visual recognition on two fundamental tasks, i.e., deep classification and deep representation learning, in spite of the significant differences between them. Extensive experiments on both deep metric learning benchmarks and deep image classification benchmarks validate the effectiveness of the proposed feature cloud.

ProAug: Prototype-Based Augmentation for Long-Tailed Image Classification.

Instance-Specific Semantic Augmentation for Long-Tailed Image Classification

Feature Space Augmentation for Long-Tailed Data

SAFA: Sample-Adaptive Feature Augmentation for Long-Tailed Image Classification

Imagine by Reasoning: A Reasoning-Based Implicit Semantic Data Augmentation for Long-Tailed Classification

Data-Centric Long-Tailed Image Recognition

A Dual Progressive Strategy for Long-Tailed Visual Recognition

Feature Cloud: Improving Deep Visual Recognition with Probabilistic Feature Augmentation

Prototype-based Classifier Learning for Long-Tailed Visual Recognition

ECS-SC: Long-tailed classification via data augmentation based on easily confused sample selection and combination

Kill Two Birds with One Stone: Rethinking Data Augmentation for Deep Long-tailed Learning

Propheter: Prophetic Teacher Guided Long-Tailed Distribution Learning

Towards Controlled Data Augmentations for Active Learning.

CUDA: Curriculum of Data Augmentation for Long-Tailed Recognition

Text-guided Fourier Augmentation for long-tailed recognition

Class Activation Maps-based Feature Augmentation for long-tailed classification

Label-Specific Feature Augmentation for Long-Tailed Multi-Label Text Classification

MetaSAug: Meta Semantic Augmentation for Long-Tailed Visual Recognition

ProCo: Prototype-aware Contrastive Learning for Long-tailed Medical Image Classification

On Data Augmentation for Extreme Multi-label Classification

The Performance Research of the Data Augmentation Method for Image Classification