Abstract:Statistical and experimental analyses of commonly used multi‐label image datasets reveal that multi‐scale variations in category targets significantly influence the task of multi‐label image classification. Based on this observation, we present a novel multi‐stage feature aggregation (MSFA) network that can be trained end‐to‐end. The experimental results and visual analysis on two mainstream multi‐label image recognition datasets validate the effectiveness of the proposed model both quantitatively and qualitatively. Multi‐label image recognition (MLR) is a significant branch of image classification that aims to assign multiple categorical labels to each input. Previous research has focused on enhancing the learning of category‐related regional features. However, the potential impact of multi‐scale distributions in intra‐ and inter‐category targets on MLR tends to be neglected. Besides, semantic consistency for categories is restricted to be considered on single‐scale features, resulting in suboptimal feature extraction. To address the limitations of above, a Multi‐stage Feature Aggregation (MSFA) network is proposed. In MSFA, a novel local feature extraction method is suggested to progressively extract category‐related high‐resolution local features in both spatial and channel dimensions. Subsequently, local and global features are fused without additional up‐ and down‐sampling to enrich the scale diversity of the features while incorporating refined class‐specific information. Furthermore, a hierarchical prediction scheme for MLR is proposed, which generates classification confidence corresponding to different scales under hierarchical loss supervision. Consequently, the final output of the network comes from the joint prediction by the classifiers on multi‐scale features, ensuring a stronger feature extraction capability. The extensive experiments have been carried on VOC and MS‐COCO datasets, and the superiority of MSFA over existing mainstream methods has been verified.

A Multi-label Image Recognition Algorithm Based on Spatial and Semantic Correlation Interaction.

SST: Spatial and Semantic Transformers for Multi-Label Image Recognition

Semantic Image Segmentation Based on Spatial Context Relations

Semantic and Correlation Disentangled Graph Convolutions for Multilabel Image Recognition.

Dual Collaborative Visual-Semantic Mapping for Multi-Label Zero-Shot Image Recognition

A multi-label image classification method combining multi-stage image semantic information and label relevance

MULTI-LABEL IMAGE RECOGNITION WITH JOINT CLASS-AWARE MAP DISENTANGLING AND LABEL CORRELATION EMBEDDING

Asymmetric Vision Transformers for Multi-Label Classification

Heterogeneous Semantic Transfer for Multi-label Recognition with Partial Labels

Diverse Instance Discovery: Vision-Transformer for Instance-Aware Multi-Label Image Recognition.

Correlative multi-label multi-instance image annotation

Diverse Instance Discovery: Vision-Transformer for Instance-Aware Multi-Label Image Recognition

Semantic-Aware Graph Matching Mechanism for Multi-Label Image Recognition

Region-Awared Transformer with Asymmetric Loss in Multi-Label Classification

Spatial Context-Aware Object-Attentional Network for Multi-Label Image Classification

Dual-stream multi-label image classification model enhanced by feature reconstruction

Category-Adaptive Cross-Modal Semantic Refinement and Transfer for Open-Vocabulary Multi-Label Recognition

S-MAT: Semantic-Driven Masked Attention Transformer for Multi-Label Aerial Image Classification.

MSFA: Multi‐stage feature aggregation network for multi‐label image recognition

Spatial-Context-Aware Deep Neural Network for Multi-Class Image Classification