Abstract:Background:Computer-aided diagnosis based on chest X-ray (CXR) is an exponentially growing field of research owing to the development of deep learning, especially convolutional neural networks (CNNs). However, due to the intrinsic locality of convolution operations, CNNs cannot model long-range dependencies. Although vision transformers (ViTs) have recently been proposed to alleviate this limitation, those trained on patches cannot learn any dependencies for inter-patch pixels and thus, are insufficient for medical image detection. To address this problem, in this paper, we propose a CXR detection method which integrates CNN with a ViT for modeling patch-wise and inter-patch dependencies.Methods:We experimented on the ChestX-ray14 dataset and followed the official training-test set split. Because the training data only had global annotations, the detection network was weakly supervised. A DenseNet with a feature pyramid structure was designed and integrated with an adaptive ViT to model inter-patch and patch-wise long-range dependencies and obtain fine-grained feature maps. We compared the performance using our method with that of other disease detection methods.Results:For disease classification, our method achieved the best result among all the disease detection methods, with a mean area under the curve (AUC) of 0.829. For lesion localization, our method achieved significantly higher intersection of the union (IoU) scores on the test images with bounding box annotations than did the other detection methods. The visualized results showed that our predictions were more accurate and detailed. Furthermore, evaluation of our method in an external validation dataset demonstrated its generalization ability.Conclusions:Our proposed method achieves the new state of the art for thoracic disease classification and weakly supervised localization. It has potential to assist in clinical decision-making.

KEXNet: A Knowledge-Enhanced Model for Improved Chest X-Ray Lesion Detection

Development of a multipotent diagnostic tool for chest X-rays by multi-object detection method

RECIST-NET: LESION DETECTION VIA GROUPING KEYPOINTS ON RECIST-BASED ANNOTATION

Learning To Recognize Thoracic Disease In Chest X-Rays With Knowledge-Guided Deep Zoom Neural Networks

Kgznet:Knowledge-Guided Deep Zoom Neural Networks For Thoracic Disease Classification

Automated Detection of Multiple Lesions on Chest X-ray Images: Classification Using a Neural Network Technique with Association-Specific Contexts

CXR-RefineDet: Single-Shot Refinement Neural Network for Chest X-Ray Radiograph Based on Multiple Lesions Detection

High-Resolution Network with Dynamic Convolution and Coordinate Attention for Classification of Chest X-ray Images.

DualAttNet: Synergistic Fusion of Image-level and Fine-Grained Disease Attention for Multi-Label Lesion Detection in Chest X-rays

Enhancing Multi-disease Diagnosis of Chest X-rays with Advanced Deep-learning Networks in Real-world Data

XProtoNet: Diagnosis in Chest Radiography with Global and Local Explanations

Dynamic Multi-Domain Knowledge Networks for Chest X-ray Report Generation

Anatomy-XNet: An Anatomy Aware Convolutional Neural Network for Thoracic Disease Classification in Chest X-rays

MRChexNet: Multi-modal bridge and relational learning for thoracic disease recognition in chest X-rays

DeepCXray: Automatically Diagnosing Diseases on Chest X-Rays Using Deep Neural Networks

Knowledge-enhanced visual-language pre-training on chest radiology images

X-Recon: Learning-based Patient-specific High-Resolution CT Reconstruction from Orthogonal X-Ray Images

Modeling Long-Range Dependencies for Weakly Supervised Disease Classification and Localization on Chest X-ray

OXnet: Omni-supervised Thoracic Disease Detection from Chest X-rays

Anatomy-Guided Weakly-Supervised Abnormality Localization in Chest X-rays

Deformation and Refined Features Based Lesion Detection on Chest X-Ray