Abstract:Background:Computer-aided diagnosis based on chest X-ray (CXR) is an exponentially growing field of research owing to the development of deep learning, especially convolutional neural networks (CNNs). However, due to the intrinsic locality of convolution operations, CNNs cannot model long-range dependencies. Although vision transformers (ViTs) have recently been proposed to alleviate this limitation, those trained on patches cannot learn any dependencies for inter-patch pixels and thus, are insufficient for medical image detection. To address this problem, in this paper, we propose a CXR detection method which integrates CNN with a ViT for modeling patch-wise and inter-patch dependencies.Methods:We experimented on the ChestX-ray14 dataset and followed the official training-test set split. Because the training data only had global annotations, the detection network was weakly supervised. A DenseNet with a feature pyramid structure was designed and integrated with an adaptive ViT to model inter-patch and patch-wise long-range dependencies and obtain fine-grained feature maps. We compared the performance using our method with that of other disease detection methods.Results:For disease classification, our method achieved the best result among all the disease detection methods, with a mean area under the curve (AUC) of 0.829. For lesion localization, our method achieved significantly higher intersection of the union (IoU) scores on the test images with bounding box annotations than did the other detection methods. The visualized results showed that our predictions were more accurate and detailed. Furthermore, evaluation of our method in an external validation dataset demonstrated its generalization ability.Conclusions:Our proposed method achieves the new state of the art for thoracic disease classification and weakly supervised localization. It has potential to assist in clinical decision-making.

Align, Attend and Locate: Chest X-Ray Diagnosis Via Contrast Induced Attention Network with Limited Supervision

Contralaterally Enhanced Networks for Thoracic Disease Detection

Chest x-ray diagnosis via spatial-channel high-order attention representation learning

Multi-attention Network for Thoracic Disease Classification and Localization

Iterative Attention Mining for Weakly Supervised Thoracic Disease Pattern Localization in Chest X-Rays

Diagnose like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification

Constrained Contrastive Representation - Classification on Chest X-Rays with Limited Data.

DualAttNet: Synergistic Fusion of Image-level and Fine-Grained Disease Attention for Multi-Label Lesion Detection in Chest X-rays

Anatomy-Guided Weakly-Supervised Abnormality Localization in Chest X-rays

Class Attention to Regions of Lesion for Imbalanced Medical Image Recognition

Thoracic Disease Identification and Localization with Limited Supervision

Identifying cardiomegaly in chest x-rays using dual attention network

Attention-Guided Curriculum Learning for Weakly Supervised Classification and Localization of Thoracic Diseases on Chest Radiographs

A multi-level feature attention network for COVID-19 detection based on multi-source medical images

A Cascade Attention Network for Liver Lesion Classification in Weakly-Labeled Multi-phase CT Images.

OXnet: Omni-supervised Thoracic Disease Detection from Chest X-rays

Attention U-net for Interpretable Classification on Chest X-ray Image

Contrastive Attention for Automatic Chest X-ray Report Generation.

Modeling Long-Range Dependencies for Weakly Supervised Disease Classification and Localization on Chest X-ray

A Locating Model for Pulmonary Tuberculosis Diagnosis in Radiographs

ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases