Abstract:Automated multi-label chest X-ray (CXR) image classification has recently made significant progress in clinical diagnosis based on the advanced deep learning techniques. However, most existing methods mainly focus on analyzing locality visual cues from a single image but fail to leverage the underlying explicit correlations among different images for precise disease diagnosis. By contrast, an experienced radiologist expertizes in transferring knowledge from previous tasks to diagnose the present radiograph. To enable the machine like a radiologist, this paper proposes a novel Semantic Similarity Graph Embedding (SSGE) framework, which explicitly explores the semantic similarities among images to optimize the visual feature embedding for improving the performance of multi-label CXR images classification. Specifically, the proposed SSGE framework contains three main components: the image feature embedding (IFE) module, similarity graph construction (SGC) module, and semantic similarity learning (SSL) module. To realize interactive teaching and learning between visual and semantic information, the proposed SSGE framework is built on the "Teacher-Student" (semantic-visual) learning mechanism. With the guidance and supervision of the cross-image similarity graph generated by the SGC module, the SSL module leverages Graph Convolutional Network (GCN) to adaptively recalibrate the multi-image feature representations extracted from the IFE module, which guarantees their semantic consistency. Furthermore, we propose a novel re-weighting strategy to learn a more optimal semantic-similarity graph for the information propagation of the GCN layers. Extensive experiments on two benchmark datasets demonstrate the effectiveness of the proposed method in comparison with some state-of-the-art baselines.

Multi-label Aerial Image Classification Via Adjacency-Based Label and Feature Co-embedding

Relation Network for Multi-label Aerial Image Classification

MULTI-LABEL IMAGE RECOGNITION WITH JOINT CLASS-AWARE MAP DISENTANGLING AND LABEL CORRELATION EMBEDDING

Label-Guided Cross-Modal Attention Network for Multi-Label Aerial Image Classification

GA-Based Weighted Ensemble Learning for Multi-Label Aerial Image Classification Using Convolutional Neural Networks and Vision Transformers

A multi-label image classification method combining multi-stage image semantic information and label relevance

Cross-Modal Feature Representation Learning and Label Graph Mining in a Residual Multi-Attentional CNN-LSTM Network for Multi-Label Aerial Scene Classification

Multi-label remote sensing image classification with deformable convolutions and graph neural networks

Multi-Label Classification with Label Graph Superimposing

Two-Stage Label Embedding Via Neural Factorization Machine for Multi-Label Classification

Correlative multi-label multi-instance image annotation

Disentangling, Embedding and Ranking Label Cues for Multi-Label Image Recognition

Semantic Embedded Deep Neural Network: A Generic Approach to Boost Multi-Label Image Classification Performance

Learning Disentangled Label Representations for Multi-label Classification

Spatial Context-Aware Object-Attentional Network for Multi-Label Image Classification

Multi-Label Chest X-Ray Image Classification via Semantic Similarity Graph Embedding

Multi-Modal Multi-Label Semantic Indexing Of Images Based On Hybrid Ensemble Learning

Incorporating Prior Knowledge Into Multi-Label Boosting For Cross-Modal Image Annotation And Retrieval

Cross-Attention-Driven Adaptive Graph Relational Network for Multilabel Remote Sensing Scene Classification

Multi-Label Image Recognition With Graph Convolutional Networks

A Label Information Aware Model for Multi-label Text Classification