Abstract:Real-world data consistently exhibits a long-tailed distribution, often spanning multiple categories. This complexity underscores the challenge of content comprehension, particularly in scenarios requiring Long-Tailed Multi-Label image Classification (LTMLC). In such contexts, imbalanced data distribution and multi-object recognition pose significant hurdles. To address this issue, we propose a novel and effective approach for LTMLC, termed Category-Prompt Refined Feature Learning (CPRFL), utilizing semantic correlations between different categories and decoupling category-specific visual representations for each category. Specifically, CPRFL initializes category-prompts from the pretrained CLIP's embeddings and decouples category-specific visual representations through interaction with visual features, thereby facilitating the establishment of semantic correlations between the head and tail classes. To mitigate the visual-semantic domain bias, we design a progressive Dual-Path Back-Propagation mechanism to refine the prompts by progressively incorporating context-related visual information into prompts. Simultaneously, the refinement process facilitates the progressive purification of the category-specific visual representations under the guidance of the refined prompts. Furthermore, taking into account the negative-positive sample imbalance, we adopt the Asymmetric Loss as our optimization objective to suppress negative samples across all classes and potentially enhance the head-to-tail recognition performance. We validate the effectiveness of our method on two LTMLC benchmarks and extensive experiments demonstrate the superiority of our work over baselines. The code is available at <a class="link-external link-https" href="https://github.com/jiexuanyan/CPRFL" rel="external noopener nofollow">this https URL</a>.

Reinforced Multi-Label Image Classification by Exploring Curriculum.

Multi-Modal Curriculum Learning for Semi-Supervised Image Classification

Causal multi-label learning for image classification

PLMCL: Partial-Label Momentum Curriculum Learning for Multi-Label Image Classification

Multi-scale and Discriminative Part Detectors Based Features for Multi-label Image Classification.

Joint multi-label multi-instance learning for image classification

A Deep Model for Partial Multi-Label Image Classification with Curriculum Based Disambiguation

Spatial Context-Aware Object-Attentional Network for Multi-Label Image Classification

Reinforced Labels: Multi-Agent Deep Reinforcement Learning for Point-Feature Label Placement

A multi-label image classification method combining multi-stage image semantic information and label relevance

Integrating hierarchical feature selection and classifier training for multi-label image annotation.

Category-Prompt Refined Feature Learning for Long-Tailed Multi-Label Image Classification

Coarse-to-Fine Curriculum Learning

Text as Image: Learning Transferable Adapter for Multi-Label Classification

Diverse and Tailored Image Generation for Zero-shot Multi-label Classification

Combining Supervised Learning and Reinforcement Learning for Multi-Label Classification Tasks with Partial Labels

Residual Attention: A Simple but Effective Method for Multi-Label Recognition

Spatial-Context-Aware Deep Neural Network for Multi-Class Image Classification

Vision-Language Pseudo-Labels for Single-Positive Multi-Label Learning

Multi-Instance Multi-Label Learning with Application to Scene Classification

Rethinking Curriculum Learning with Incremental Labels and Adaptive Compensation