Abstract:Background: The combination of anatomical MRI and deep learning-based methods such as convolutional neural networks (CNNs) is a promising strategy to build predictive models of multiple sclerosis (MS) prognosis. However, studies assessing the effect of different input strategies on model's performance are lacking. Purpose: To compare whole-brain input sampling strategies and regional/specific-tissue strategies, which focus on a priori known relevant areas for disability accrual, to stratify MS patients based on their disability level. Study type: Retrospective. Subjects: Three hundred nineteen MS patients (382 brain MRI scans) with clinical assessment of disability level performed within the following 6 months (~70% training/~15% validation/~15% inference in-house dataset) and 440 MS patients from multiple centers (independent external validation cohort). Field strength/sequence: Single vendor 1.5 T or 3.0 T. Magnetization-Prepared Rapid Gradient-Echo and Fluid-Attenuated Inversion Recovery sequences. Assessment: A 7-fold patient cross validation strategy was used to train a 3D-CNN to classify patients into two groups, Expanded Disability Status Scale score (EDSS) ≥ 3.0 or EDSS < 3.0. Two strategies were investigated: 1) a global approach, taking the whole brain volume as input and 2) regional approaches using five different regions-of-interest: white matter, gray matter, subcortical gray matter, ventricles, and brainstem structures. The performance of the models was assessed in the in-house and the independent external cohorts. Statistical tests: Balanced accuracy, sensitivity, specificity, area under receiver operating characteristic (ROC) curve (AUC). Results: With the in-house dataset, the gray matter regional model showed the highest stratification accuracy (81%), followed by the global approach (79%). In the external dataset, without any further retraining, an accuracy of 72% was achieved for the white matter model and 71% for the global approach. Data conclusion: The global approach offered the best trade-off between internal performance and external validation to stratify MS patients based on accumulated disability. Evidence level: 4 TECHNICAL EFFICACY: Stage 2.

Predicting disease-related MRI patterns of multiple sclerosis through GAN-based image editing

Multi-modal Perceptual Adversarial Learning for Longitudinal Prediction of Infant MR Images

Lesion-Specific Prediction with Discriminator-Based Supervised Guided Attention Module Enabled GANs in Multiple Sclerosis

Data augmentation using generative adversarial neural networks on brain structural connectivity in multiple sclerosis

Temporally Adjustable Longitudinal Fluid-Attenuated Inversion Recovery MRI Estimation / Synthesis for Multiple Sclerosis

LDGAN: Longitudinal-Diagnostic Generative Adversarial Network for Disease Progression Prediction with Missing Structural MRI

Cross-Modality Augmentation Of Brain Mr Images Using A Novel Pairwise Generative Adversarial Network For Enhanced Glioma Classification

Learning Myelin Content in Multiple Sclerosis from Multimodal MRI through Adversarial Training

Global and Regional Deep Learning Models for Multiple Sclerosis Stratification From MRI

Predicting multiple sclerosis disease severity with multimodal deep neural networks

Multi-contrast high-field quality image synthesis for portable low-field MRI using generative adversarial networks and paired data

Prediction of Alzheimer's Disease Progression with Multi-Information Generative Adversarial Network

An Empirical Analysis of Diffusion, Autoencoders, and Adversarial Deep Learning Models for Predicting Dementia Using High-Fidelity MRI

Enhancing magnetic resonance imaging-driven Alzheimer’s disease classification performance using generative adversarial learning

Adversarial Learning for MRI Reconstruction and Classification of Cognitively Impaired Individuals

Brain Status Transferring Generative Adversarial Network for Decoding Individualized Atrophy in Alzheimer's Disease

A generalizable deep voxel-guided morphometry algorithm for the detection of subtle lesion dynamics in multiple sclerosis

Self-pruning Graph Neural Network for Predicting Inflammatory Disease Activity in Multiple Sclerosis from Brain MR Images

Addressing the Generalizability of AI in Radiology Using a Novel Data Augmentation Framework with Synthetic Patient Image Data: Proof-of-Concept and External Validation for Classification Tasks in Multiple Sclerosis

Predicting PET-derived Demyelination from Multimodal MRI Using Sketcher-Refiner Adversarial Training for Multiple Sclerosis.

Predicting multiple sclerosis disease progression and outcomes with machine learning and MRI-based biomarkers: a review