Abstract:Statistical and experimental analyses of commonly used multi‐label image datasets reveal that multi‐scale variations in category targets significantly influence the task of multi‐label image classification. Based on this observation, we present a novel multi‐stage feature aggregation (MSFA) network that can be trained end‐to‐end. The experimental results and visual analysis on two mainstream multi‐label image recognition datasets validate the effectiveness of the proposed model both quantitatively and qualitatively. Multi‐label image recognition (MLR) is a significant branch of image classification that aims to assign multiple categorical labels to each input. Previous research has focused on enhancing the learning of category‐related regional features. However, the potential impact of multi‐scale distributions in intra‐ and inter‐category targets on MLR tends to be neglected. Besides, semantic consistency for categories is restricted to be considered on single‐scale features, resulting in suboptimal feature extraction. To address the limitations of above, a Multi‐stage Feature Aggregation (MSFA) network is proposed. In MSFA, a novel local feature extraction method is suggested to progressively extract category‐related high‐resolution local features in both spatial and channel dimensions. Subsequently, local and global features are fused without additional up‐ and down‐sampling to enrich the scale diversity of the features while incorporating refined class‐specific information. Furthermore, a hierarchical prediction scheme for MLR is proposed, which generates classification confidence corresponding to different scales under hierarchical loss supervision. Consequently, the final output of the network comes from the joint prediction by the classifiers on multi‐scale features, ensuring a stronger feature extraction capability. The extensive experiments have been carried on VOC and MS‐COCO datasets, and the superiority of MSFA over existing mainstream methods has been verified.

MSFA: Multi‐stage feature aggregation network for multi‐label image recognition

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

Multi-Scale Cross-Modal Spatial Attention Fusion for Multi-label Image Recognition.

Multi-layered Semantic Representation Network for Multi-label Image Classification

A multi-label image classification method combining multi-stage image semantic information and label relevance

MSFF: A Multi-Scale Feature Fusion Convolutional Neural Network for Hyperspectral Image Classification

A Multi-Scale Feature Aggregation Network Based on Channel-Spatial Attention for Remote Sensing Scene Classification

MFSA-Net: Semantic Segmentation with Camera-LiDAR Cross-Attention Fusion Based on Fast Neighbor Feature Aggregation

A Multi-scale Semantic Attention Representation for Multi-Label Image Recognition with Graph Networks

A multi-scale multi-attention network for dynamic facial expression recognition

MSFMamba: Multi-Scale Feature Fusion State Space Model for Multi-Source Remote Sensing Image Classification

MSML: Enhancing Occlusion-Robustness by Multi-Scale Segmentation-Based Mask Learning for Face Recognition

Multi-Scale Fine-Grained Alignments for Image and Sentence Matching

MFALNet: A Multiscale Feature Aggregation Lightweight Network for Semantic Segmentation of High-Resolution Remote Sensing Images.

Remote Sensing Image Semantic Segmentation Network Based on Multi-Scale Feature Enhancement Fusion

Multi-Scale Hybrid Fusion Network for Mandarin Audio-Visual Speech Recognition

MMF: Multi-Task Multi-Structure Fusion for Hierarchical Image Classification

Multi-Stage Fusion and Multi-Source Attention Network for Multi-Modal Remote Sensing Image Segmentation.

Multibranch Spatial-Channel Attention for Semantic Labeling of Very High-Resolution Remote Sensing Images.

Fast Graph Convolution Network Based Multi-label Image Recognition via Cross-modal Fusion

Dual-stream multi-label image classification model enhanced by feature reconstruction