Abstract:As an autoimmune-mediated inflammatory demyelinating disease of the central nervous system, multiple sclerosis (MS) is often confused with cerebral small vessel disease (cSVD), which is a regional pathological change in brain tissue with unknown pathogenesis. This is due to their similar clinical presentations and imaging manifestations. That misdiagnosis can significantly increase the occurrence of adverse events. Delayed or incorrect treatment is one of the most important causes of MS progression. Therefore, the development of a practical diagnostic imaging aid could significantly reduce the risk of misdiagnosis and improve patient prognosis. We propose an interpretable deep learning (DL) model that differentiates MS and cSVD using T2-weighted fluid-attenuated inversion recovery (FLAIR) images. Transfer learning (TL) was utilized to extract features from the ImageNet dataset. This pioneering model marks the first of its kind in neuroimaging, showing great potential in enhancing differential diagnostic capabilities within the field of neurological disorders. Our model extracts the texture features of the images and achieves more robust feature learning through two attention modules. The attention maps provided by the attention modules provide model interpretation to validate model learning and reveal more information to physicians. Finally, the proposed model is trained end-to-end using focal loss to reduce the influence of class imbalance. The model was validated using clinically diagnosed MS () and cSVD () patients from the Beijing Tiantan Hospital. The performance of the proposed model was better than that of two commonly used DL approaches, with a mean balanced accuracy of 86.06% and a mean area under the receiver operating characteristic curve of 98.78%. Moreover, the generated attention heat maps showed that the proposed model could focus on the lesion signatures in the image. The proposed model provides a practical diagnostic imaging aid for the use of routinely available imaging techniques such as magnetic resonance imaging to classify MS and cSVD by linking DL to human brain disease. We anticipate a substantial improvement in accurately distinguishing between various neurological conditions through this novel model.

Multi-attentional causal intervention networks for medical image diagnosis

Towards Multi-dimensional Explanation Alignment for Medical Classification

Exploiting causality signals in medical images: A pilot study with empirical results

Attention-based Multi-instance Neural Network for Medical Diagnosis from Incomplete and Low Quality Data

MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Network

Mutual Attention-based Hybrid Dimensional Network for Multimodal Imaging Computer-aided Diagnosis

Class Attention to Regions of Lesion for Imbalanced Medical Image Recognition

IMAL‐Net: Interpretable multi‐task attention learning network for invasive lung adenocarcinoma screening in CT images

C2MA-Net: Cross-Modal Cross-Attention Network for Acute Ischemic Stroke Lesion Segmentation Based on CT Perfusion Scans

MICA: Towards Explainable Skin Lesion Diagnosis via Multi-Level Image-Concept Alignment

Multimodal parallel attention network for medical image segmentation

A Synergic Neural Network for Medical Image Classification Based on Attention Mechanism

MSAIF-Net: A Multistage Spatial Attention-Based Invertible Fusion Network for MR Images.

Counterfactual Causal-Effect Intervention for Interpretable Medical Visual Question Answering

FeaInfNet: Diagnosis in Medical Image with Feature-Driven Inference and Visual Explanations

Progressive attention integration-based multi-scale efficient network for medical imaging analysis with application to COVID-19 diagnosis

TL-CCL: Two-level causal contrastive learning for multi-label ocular disease diagnosis with fundus images

Contour extraction of medical images using an attention-based network

Improving the classification of multiple sclerosis and cerebral small vessel disease with interpretable transfer attention neural network

TA-Net: Triple attention network for medical image segmentation