Abstract:The CNN has achieved excellent results in the automatic classification of medical images. In this study, we propose a novel deep residual 3D attention non-local network (NL-RAN) to classify CT images included COVID-19, common pneumonia, and normal to perform rapid and explainable COVID-19 diagnosis. We built a deep residual 3D attention non-local network that could achieve end-to-end training. The network is embedded with a nonlocal module to capture global information, while a 3D attention module is embedded to focus on the details of the lesion so that it can directly analyze the 3D lung CT and output the classification results. The output of the attention module can be used as a heat map to increase the interpretability of the model. 4079 3D CT scans were included in this study. Each scan had a unique label (novel coronavirus pneumonia, common pneumonia, and normal). The CT scans cohort was randomly split into a training set of 3263 scans, a validation set of 408 scans, and a testing set of 408 scans. And compare with existing mainstream classification methods, such as CovNet, CBAM, ResNet, etc. Simultaneously compare the visualization results with visualization methods such as CAM. Model performance was evaluated using the Area Under the ROC Curve(AUC), precision, and F1-score. The NL-RAN achieved the AUC of 0.9903, the precision of 0.9473, and the F1-score of 0.9462, surpass all the classification methods compared. The heat map output by the attention module is also clearer than the heat map output by CAM. Our experimental results indicate that our proposed method performs significantly better than existing methods. In addition, the first attention module outputs a heat map containing detailed outline information to increase the interpretability of the model. Our experiments indicate that the inference of our model is fast. It can provide real-time assistance with diagnosis.

Diagnosis of pulmonary tuberculosis with 3D neural network based on multi-scale attention mechanism

Development and Validation of a 3D-Convolutional Neural Network Model Based on Chest CT for Differentiating Active Pulmonary Tuberculosis from Community-Acquired Pneumonia

Multimodality Attention-Guided 3-D Detection of Nonsmall Cell Lung Cancer in 18 F-FDG PET/CT Images

CT Images Recognition of Pulmonary Tuberculosis Based on Improved Faster RCNN and U-Net

An Original Neural Network For Pulmonary Tuberculosis Diagnosis In Radiographs

Automated thorax disease diagnosis using multi-branch residual attention network

DARNet: Dual-Attention Residual Network for Automatic Diagnosis of COVID-19 Via CT Images

Attention-guided deep neural network with a multichannel architecture for lung nodule classification

A diagnostic classification of lung nodules using multiple-scale residual network

Deep Learning Models of Multi-Scale Lesion Perception Attention Networks for Diagnosis and Staging of Pneumoconiosis: A Comparative Study with Radiologists

A general approach for automatic segmentation of pneumonia, pulmonary nodule, and tuberculosis in CT images

Detection of Pulmonary Nodules in CT Images Based on 3D Multi-Scale Retina Vnet

PtbNet: Based on Local Few-Shot Classes and Small Objects to accurately detect PTB

An Explainable Non-local Network for COVID-19 Diagnosis

DBPNDNet: dual-branch networks using 3DCNN toward pulmonary nodule detection

A deep learning system that generates quantitative CT reports for diagnosing pulmonary Tuberculosis

An attention-based deep learning network for lung nodule malignancy discrimination

Deep-Learning Model of ResNet Combined with CBAM for Malignant–Benign Pulmonary Nodules Classification on Computed Tomography Images

A Multi-Task Self-Normalizing 3D-CNN to Infer Tuberculosis Radiological Manifestations

MSD-Net: Multi-Scale Discriminative Network for COVID-19 Lung Infection Segmentation on CT

Deep learning based CT images automatic analysis model for active/non-active pulmonary tuberculosis differential diagnosis