Abstract:While diagnosing multiple lesion regions in chest X-ray (CXR) images, radiologists usually apply pathological relationships in medicine before making decisions. Therefore, a comprehensive analysis of labeling relationships in different data modes is essential to improve the recognition performance of the model. However, most automated CXR diagnostic methods that consider pathological relationships treat different data modalities as independent learning objects, ignoring the alignment of pathological relationships among different data modalities. In addition, some methods that use undirected graphs to model pathological relationships ignore the directed information, making it difficult to model all pathological relationships accurately. In this paper, we propose a novel multi-label CXR classification model called MRChexNet that consists of three modules: a representation learning module (RLM), a multi-modal bridge module (MBM) and a pathology graph learning module (PGL). RLM captures specific pathological features at the image level. MBM performs cross-modal alignment of pathology relationships in different data modalities. PGL models directed relationships between disease occurrences as directed graphs. Finally, the designed graph learning block in PGL performs the integrated learning of pathology relationships in different data modalities. We evaluated MRChexNet on two large-scale CXR datasets (ChestX-Ray14 and CheXpert) and achieved state-of-the-art performance. The mean area under the curve (AUC) scores for the 14 pathologies were 0.8503 (ChestX-Ray14) and 0.8649 (CheXpert). MRChexNet effectively aligns pathology relationships in different modalities and learns more detailed correlations between pathologies. It demonstrates high accuracy and generalization compared to competing approaches. MRChexNet can contribute to thoracic disease recognition in CXR.

Modeling Global and Local Label Correlation with Graph Convolutional Networks for Multi-Label Chest X-ray Image Classification

Label Semantic Improvement with Graph Convolutional Networks for Multi-Label Chest X-Ray Image Classification

Multi-Label Local to Global Learning: A Novel Learning Paradigm for Chest X-Ray Abnormality Classification.

Multi-label local awareness and global co-occurrence priori learning improve chest X-ray classification

Label correlation guided discriminative label feature learning for multi-label chest image classification

CorLabelNet: a Comprehensive Framework for Multi-Label Chest X-ray Image Classification with Correlation Guided Discriminant Feature Learning and Oversampling

GCN-RNN: an Unified Framework for Modeling the Multi-Label Diagnosis of Chest X-ray Disease

Learning group-wise spatial attention and label dependencies for multi-task thoracic disease classification

BB-GCN: A Bi-modal Bridged Graph Convolutional Network for Multi-label Chest X-Ray Recognition

Multi-Label Chest X-Ray Image Classification via Semantic Similarity Graph Embedding

Deep Learning Based Classification of Multi-Label Chest X-ray Images Via Dual-Weighted Metric Loss

Multi-label neural architecture search for chest radiography image classification

Label Generation Network based on Self-selected Historical Information for Multiple Disease Classification on Chest Radiography.

MRChexNet: Multi-modal bridge and relational learning for thoracic disease recognition in chest X-rays

Multi-Label Learning With Visual-Semantic Embedded Knowledge Graph for Diagnosis of Radiology Imaging

Chest X-rays Classification: A Multi-Label and Fine-Grained Problem

Multi-Label Generalized Zero Shot Chest Xray Classification By Combining Image-Text Information With Feature Disentanglement

Deep Learning Based Multi-Label Chest X-Ray Classification with Entropy Weighting Loss

Two-stream Collaborative Network for Multi-Label Chest X-ray Image Classification with Lung Segmentation

Multi-label Chest X-ray Image Classification Via Category-Wise Residual Attention Learning

Multi-Label Chest X-Ray Classification via Deep Learning