Abstract:While diagnosing multiple lesion regions in chest X-ray (CXR) images, radiologists usually apply pathological relationships in medicine before making decisions. Therefore, a comprehensive analysis of labeling relationships in different data modes is essential to improve the recognition performance of the model. However, most automated CXR diagnostic methods that consider pathological relationships treat different data modalities as independent learning objects, ignoring the alignment of pathological relationships among different data modalities. In addition, some methods that use undirected graphs to model pathological relationships ignore the directed information, making it difficult to model all pathological relationships accurately. In this paper, we propose a novel multi-label CXR classification model called MRChexNet that consists of three modules: a representation learning module (RLM), a multi-modal bridge module (MBM) and a pathology graph learning module (PGL). RLM captures specific pathological features at the image level. MBM performs cross-modal alignment of pathology relationships in different data modalities. PGL models directed relationships between disease occurrences as directed graphs. Finally, the designed graph learning block in PGL performs the integrated learning of pathology relationships in different data modalities. We evaluated MRChexNet on two large-scale CXR datasets (ChestX-Ray14 and CheXpert) and achieved state-of-the-art performance. The mean area under the curve (AUC) scores for the 14 pathologies were 0.8503 (ChestX-Ray14) and 0.8649 (CheXpert). MRChexNet effectively aligns pathology relationships in different modalities and learns more detailed correlations between pathologies. It demonstrates high accuracy and generalization compared to competing approaches. MRChexNet can contribute to thoracic disease recognition in CXR.

GCN-RNN: an Unified Framework for Modeling the Multi-Label Diagnosis of Chest X-ray Disease

Label Semantic Improvement with Graph Convolutional Networks for Multi-Label Chest X-Ray Image Classification

BB-GCN: A Bi-modal Bridged Graph Convolutional Network for Multi-label Chest X-Ray Recognition

ImageGCN: Multi-Relational Image Graph Convolutional Networks for Disease Identification with Chest X-rays

Modeling Global and Local Label Correlation with Graph Convolutional Networks for Multi-Label Chest X-ray Image Classification

Label Generation Network based on Self-selected Historical Information for Multiple Disease Classification on Chest Radiography.

Multi-Label Local to Global Learning: A Novel Learning Paradigm for Chest X-Ray Abnormality Classification.

CheXNet: Combing Transformer and CNN for Thorax Disease Diagnosis from Chest X-ray Images.

Multi-label local awareness and global co-occurrence priori learning improve chest X-ray classification

Learning group-wise spatial attention and label dependencies for multi-task thoracic disease classification

Multi-disease X-ray Image Classification of the Chest Based on Global and Local Fusion Adaptive Networks

Deep Learning Based Classification of Multi-Label Chest X-ray Images Via Dual-Weighted Metric Loss

Diagnose Chest Pathology In X-Ray Images By Learning Multi-Attention Convolutional Neural Network

Multi-label neural architecture search for chest radiography image classification

Multi-Label Classification of Chest X-ray Abnormalities Using Transfer Learning Techniques

Chest X-ray Disease Classification Based on Attentional and Label Correlation

Chest X-rays Classification: A Multi-Label and Fine-Grained Problem

GGAC: Multi-relational image gated GCN with attention convolutional binary neural tree for identifying disease with chest X-rays

Multi-label Chest X-ray Image Classification Via Category-Wise Residual Attention Learning

CheXNet and feature pyramid network: a fusion deep learning architecture for multilabel chest X-Ray clinical diagnoses classification

MRChexNet: Multi-modal bridge and relational learning for thoracic disease recognition in chest X-rays