Abstract:While diagnosing multiple lesion regions in chest X-ray (CXR) images, radiologists usually apply pathological relationships in medicine before making decisions. Therefore, a comprehensive analysis of labeling relationships in different data modes is essential to improve the recognition performance of the model. However, most automated CXR diagnostic methods that consider pathological relationships treat different data modalities as independent learning objects, ignoring the alignment of pathological relationships among different data modalities. In addition, some methods that use undirected graphs to model pathological relationships ignore the directed information, making it difficult to model all pathological relationships accurately. In this paper, we propose a novel multi-label CXR classification model called MRChexNet that consists of three modules: a representation learning module (RLM), a multi-modal bridge module (MBM) and a pathology graph learning module (PGL). RLM captures specific pathological features at the image level. MBM performs cross-modal alignment of pathology relationships in different data modalities. PGL models directed relationships between disease occurrences as directed graphs. Finally, the designed graph learning block in PGL performs the integrated learning of pathology relationships in different data modalities. We evaluated MRChexNet on two large-scale CXR datasets (ChestX-Ray14 and CheXpert) and achieved state-of-the-art performance. The mean area under the curve (AUC) scores for the 14 pathologies were 0.8503 (ChestX-Ray14) and 0.8649 (CheXpert). MRChexNet effectively aligns pathology relationships in different modalities and learns more detailed correlations between pathologies. It demonstrates high accuracy and generalization compared to competing approaches. MRChexNet can contribute to thoracic disease recognition in CXR.

CheXNet: Combing Transformer and CNN for Thorax Disease Diagnosis from Chest X-ray Images.

CheXNet and feature pyramid network: a fusion deep learning architecture for multilabel chest X-Ray clinical diagnoses classification

SwinCheX: Multi-label classification on chest X-ray images with transformers

Diagnose Chest Pathology In X-Ray Images By Learning Multi-Attention Convolutional Neural Network

SynthEnsemble: A Fusion of CNN, Vision Transformer, and Hybrid Models for Multi-Label Chest X-Ray Classification

MRChexNet: Multi-modal bridge and relational learning for thoracic disease recognition in chest X-rays

MS-ANet: Deep Learning for Automated Multi-Label Thoracic Disease Detection and Classification.

Anatomy-XNet: An Anatomy Aware Convolutional Neural Network for Thoracic Disease Classification in Chest X-rays

High-Resolution Network with Dynamic Convolution and Coordinate Attention for Classification of Chest X-ray Images.

CTransCNN: Combining transformer and CNN in multilabel medical image classification

ChestNet: A Deep Neural Network for Classification of Thoracic Diseases on Chest Radiography.

BB-GCN: A Bi-modal Bridged Graph Convolutional Network for Multi-label Chest X-Ray Recognition

Automated thorax disease diagnosis using multi-branch residual attention network

Diagnose like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification

Multi-Level Residual Feature Fusion Network for Thoracic Disease Classification in Chest X-Ray Images.

Multi-disease X-ray Image Classification of the Chest Based on Global and Local Fusion Adaptive Networks

Computer-Aided Diagnosis of Thoracic Diseases in Chest X-rays using hybrid CNN-Transformer Architecture

Thorax-Net: an Attention Regularized Deep Neural Network for Classification of Thoracic Diseases on Chest Radiography.

GCN-RNN: an Unified Framework for Modeling the Multi-Label Diagnosis of Chest X-ray Disease

TransDD: A transformer-based dual-path decoder for improving the performance of thoracic diseases classification using chest X-ray

Thorax Disease Classification with Attention Guided Convolutional Neural Network.