Abstract:Background: Differential diagnosis of demyelinating diseases of the central nervous system is a challenging task that is prone to errors and inconsistent reading, requiring expertise and additional examination approaches. Advancements in deep-learning-based image interpretations allow for prompt and automated analyses of conventional magnetic resonance imaging (MRI), which can be utilized in classifying multi-sequence MRI, and thus may help in subsequent treatment referral. Methods: Imaging and clinical data from 290 patients diagnosed with demyelinating diseases from August 2013 to October 2021 were included for analysis, including 67 patients with multiple sclerosis (MS), 162 patients with aquaporin 4 antibody-positive (AQP4+) neuromyelitis optica spectrum disorder (NMOSD), and 61 patients with myelin oligodendrocyte glycoprotein antibody-associated disease (MOGAD). Considering the heterogeneous nature of lesion size and distribution in demyelinating diseases, multi-modal MRI of brain and/or spinal cord were utilized to build the deep-learning model. This novel transformer-based deep-learning model architecture was designed to be versatile in handling with multiple image sequences (coronal T2-weighted and sagittal T2-fluid attenuation inversion recovery) and scanning locations (brain and spinal cord) for differentiating among MS, NMOSD, and MOGAD. Model performances were evaluated using the area under the receiver operating curve (AUC) and the confusion matrices measurements. The classification accuracy between the fusion model and the neuroradiological raters was also compared. Results: The fusion model that was trained with combined brain and spinal cord MRI achieved an overall improved performance, with the AUC of 0.933 (95%CI: 0.848, 0.991), 0.942 (95%CI: 0.879, 0.987) and 0.803 (95%CI: 0.629, 0.949) for MS, AQP4+ NMOSD, and MOGAD, respectively. This exceeded the performance using the brain or spinal cord MRI alone for the identification of the AQP4+ NMOSD (AUC of 0.940, brain only and 0.689, spinal cord only) and MOGAD (0.782, brain only and 0.714, spinal cord only). In the multi-category classification, the fusion model had an accuracy of 81.4%, which was significantly higher compared to rater 1 (64.4%, p=0.04<0.05) and comparable to rater 2 (74.6%, p=0.388). Conclusion: The proposed novel transformer-based model showed desirable performance in the differentiation of MS, AQP4+ NMOSD, and MOGAD on brain and spinal cord MRI, which is comparable to that of neuroradiologists. Our model is thus applicable for interpretating conventional MRI in the differential diagnosis of demyelinating diseases with overlapping lesions.

A joint model for lesion segmentation and classification of MS and NMOSD

Joint Radiomics and Spatial Distribution Model for MRI-based Discrimination of Multiple Sclerosis, Neuromyelitis Optica Spectrum Disorder, and Myelin-Oligodendrocyte-glycoprotein-igg-associated Disorder.

Improved UNet‐based Magnetic Resonance Imaging Segmentation of Demyelinating Diseases with Small Lesion Regions

Mutual Information-Based Graph Co-Attention Networks for Multimodal Prior-Guided Magnetic Resonance Imaging Segmentation

Joint segmentation and classification of skin lesions via a multi-task learning convolutional neural network

Cross Attention Densely Connected Networks For Multiple Sclerosis Lesion Segmentation

Towards an accurate and generalizable multiple sclerosis lesion segmentation model using self-ensembled lesion fusion

Differentiation between multiple sclerosis and neuromyelitis optica spectrum disorder using a deep learning model

Compound attention embedded dual channel encoder-decoder for ms lesion segmentation from brain MRI

Improving the classification of multiple sclerosis and cerebral small vessel disease with interpretable transfer attention neural network

Transformer-Based Deep-Learning Algorithm for Discriminating Demyelinating Diseases of the Central Nervous System With Neuroimaging

Multi-task Neural Networks for Joint Hippocampus Segmentation and Clinical Score Regression

Improving Multiple Sclerosis Lesion Segmentation Across Clinical Sites: A Federated Learning Approach with Noise-Resilient Training

Deep Learning with Diffusion Basis Spectrum Imaging for Classification of Multiple Sclerosis Lesions

Efficient Segmentation Model Using MRI Images and Deep Learning Techniques for Multiple Sclerosis Classification

2.5D transfer deep learning model for segmentation of contrast-enhancing lesions on brain magnetic resonance imaging of multiple sclerosis and neuromyelitis optica spectrum disorder

Investigation of an efficient multi-modal convolutional neural network for multiple sclerosis lesion detection

Deep Attention and Graphical Neural Network for Multiple Sclerosis Lesion Segmentation From MR Imaging Sequences

Hybrid Feature Network Driven by Attention and Graph Features for Multiple Sclerosis Lesion Segmentation from MR Images

3D Compressed Convolutional Neural Network Differentiates Neuromyelitis Optical Spectrum Disorders From Multiple Sclerosis Using Automated White Matter Hyperintensities Segmentations

Toward Generalizable Multiple Sclerosis Lesion Segmentation Models