Abstract:<p>Real-world visual data often exhibits a long-tailed distribution, where some "head" classes have a large number of samples, yet only a few samples are available for "tail" classes. The fundamental problem of learning with the imbalanced data is that insufficient training samples easily lead to the over-fitting of feature extractor and classifier for tail classes, which can be boiled down into a dilemma: on the one hand, we prefer to increase the exposure of tail class samples to avoid the excessive dominance of head classes in the classifier training. On the other hand, oversampling tail classes makes the network prone to over-fitting, since head class samples are often consequently under-represented. To resolve this dilemma, in this paper, we propose an effective auxiliary learning approach. The key idea is to split a network into a classifier part and a feature extractor part, and then employ different training strategies for each part in an auxiliary learning manner. Specifically, to promote the awareness of tail-classes, a class-balanced sampling scheme is utilised for training both the classifier and the feature extractor as the primary task. For the feature extractor, we also introduce an auxiliary training task, which is to train a classifier under the regular random sampling scheme. In this way, the feature extractor is jointly trained from both sampling strategies and thus can take advantage of all training data and avoid the over-fitting issue. Apart from this basic auxiliary task, we further explore the benefits of different types of auxiliary tasks for improving the generality of learned features, including self-supervised learning and class-wise re-weighting. Without using any bells and whistles, our model compares favourably over state-of-the-art solutions.</p>

Contrastive-weighted Self-Supervised Model for Long-Tailed Data Classification with Vision Transformer Augmented

Bt-Vmf Contrastive and Collaborative Learning for Long-Tailed Visual Recognition

A self-attention based contrastive learning method for bearing fault diagnosis

Balanced Contrastive Learning for Long-Tailed Visual Recognition

Contrastive Learning with Hallucinating Data for Long-Tailed Face Recognition.

Contrastive Learning Based Hybrid Networks for Long-Tailed Image Classification

Multi-sensor data fusion-enabled lightweight convolutional double regularization contrast transformer for aerospace bearing small samples fault diagnosis

Spatial-Spectral-Associative Contrastive Learning for Satellite Hyperspectral Image Classification with Transformers.

Multi-expert contrastive learning for remote sensing long-tailed image classification

Uniformly Distributed Category Prototype-Guided Vision-Language Framework for Long-Tail Recognition

Long-Short Temporal Contrastive Learning of Video Transformers

A Dual Progressive Strategy for Long-Tailed Visual Recognition

Exploring the auxiliary learning for long-tailed visual recognition

An adaptive fault diagnosis framework under class-imbalanced conditions based on contrastive augmented deep reinforcement learning

Decoupled Contrastive Learning for Long-Tailed Recognition

A Deep Learning Model for Long-Tail Visual Recognition

Improving Contrastive Learning by Visualizing Feature Transformation

Continuous Contrastive Learning for Long-Tailed Semi-Supervised Recognition

Online Continual Learning with Contrastive Vision Transformer

Targeted Supervised Contrastive Learning for Long-Tailed Recognition

Imbalanced Fault Diagnosis by Supervised Contrastive Learning