SGR stalemate: hope fades for long-term solution from Congress.

R. Daly,J. Zigmond

2012-02-13

Modern Healthcare

Abstract:

What problem does this paper attempt to address?

Predicting multiple sclerosis disease severity with multimodal deep neural networks

Kai Zhang,John A. Lincoln,Xiaoqian Jiang,Elmer V. Bernstam,Shayan Shams

2023-04-09

Abstract:Multiple Sclerosis (MS) is a chronic disease developed in human brain and spinal cord, which can cause permanent damage or deterioration of the nerves. The severity of MS disease is monitored by the Expanded Disability Status Scale (EDSS), composed of several functional sub-scores. Early and accurate classification of MS disease severity is critical for slowing down or preventing disease progression via applying early therapeutic intervention strategies. Recent advances in deep learning and the wide use of Electronic Health Records (EHR) creates opportunities to apply data-driven and predictive modeling tools for this goal. Previous studies focusing on using single-modal machine learning and deep learning algorithms were limited in terms of prediction accuracy due to the data insufficiency or model simplicity. In this paper, we proposed an idea of using patients' multimodal longitudinal and longitudinal EHR data to predict multiple sclerosis disease severity at the hospital visit. This work has two important contributions. First, we describe a pilot effort to leverage structured EHR data, neuroimaging data and clinical notes to build a multi-modal deep learning framework to predict patient's MS disease severity. The proposed pipeline demonstrates up to 25% increase in terms of the area under the Area Under the Receiver Operating Characteristic curve (AUROC) compared to models using single-modal data. Second, the study also provides insights regarding the amount useful signal embedded in each data modality with respect to MS disease prediction, which may improve data collection processes.

Machine Learning,Artificial Intelligence
Machine-learning-based prediction of disability progression in multiple sclerosis: An observational, international, multi-center study

Edward De Brouwer,Thijs Becker,Lorin Werthen-Brabants,Pieter Dewulf,Dimitrios Iliadis,Cathérine Dekeyser,Guy Laureys,Bart Van Wijmeersch,Veronica Popescu,Tom Dhaene,Dirk Deschrijver,Willem Waegeman,Bernard De Baets,Michiel Stock,Dana Horakova,Francesco Patti,Guillermo Izquierdo,Sara Eichau,Marc Girard,Alexandre Prat,Alessandra Lugaresi,Pierre Grammond,Tomas Kalincik,Raed Alroughani,Francois Grand'Maison,Olga Skibina,Murat Terzi,Jeannette Lechner-Scott,Oliver Gerlach,Samia J Khoury,Elisabetta Cartechini,Vincent Van Pesch,Maria José Sà,Bianca Weinstock-Guttman,Yolanda Blanco,Radek Ampapa,Daniele Spitaleri,Claudio Solaro,Davide Maimone,Aysun Soysal,Gerardo Iuliano,Riadh Gouider,Tamara Castillo-Triviño,José Luis Sánchez-Menoyo,Anneke van der Walt,Jiwon Oh,Eduardo Aguera-Morales,Ayse Altintas,Abdullah Al-Asmi,Koen de Gans,Yara Fragoso,Tunde Csepany,Suzanne Hodgkinson,Norma Deri,Talal Al-Harbi,Bruce Taylor,Orla Gray,Patrice Lalive,Csilla Rozsa,Chris McGuigan,Allan Kermode,Angel Pérez Sempere,Simu Mihaela,Magdolna Simo,Todd Hardy,Danny Decoo,Stella Hughes,Nikolaos Grigoriadis,Attila Sas,Norbert Vella,Yves Moreau,Liesbet Peeters

DOI: https://doi.org/10.1371/journal.pdig.0000533

2024-07-25

Abstract:Background: Disability progression is a key milestone in the disease evolution of people with multiple sclerosis (PwMS). Prediction models of the probability of disability progression have not yet reached the level of trust needed to be adopted in the clinic. A common benchmark to assess model development in multiple sclerosis is also currently lacking. Methods: Data of adult PwMS with a follow-up of at least three years from 146 MS centers, spread over 40 countries and collected by the MSBase consortium was used. With basic inclusion criteria for quality requirements, it represents a total of 15, 240 PwMS. External validation was performed and repeated five times to assess the significance of the results. Transparent Reporting for Individual Prognosis Or Diagnosis (TRIPOD) guidelines were followed. Confirmed disability progression after two years was predicted, with a confirmation window of six months. Only routinely collected variables were used such as the expanded disability status scale, treatment, relapse information, and MS course. To learn the probability of disability progression, state-of-the-art machine learning models were investigated. The discrimination performance of the models is evaluated with the area under the receiver operator curve (ROC-AUC) and under the precision recall curve (AUC-PR), and their calibration via the Brier score and the expected calibration error. All our preprocessing and model code are available at https://gitlab.com/edebrouwer/ms_benchmark, making this task an ideal benchmark for predicting disability progression in MS. Findings: Machine learning models achieved a ROC-AUC of 0⋅71 ± 0⋅01, an AUC-PR of 0⋅26 ± 0⋅02, a Brier score of 0⋅1 ± 0⋅01 and an expected calibration error of 0⋅07 ± 0⋅04. The history of disability progression was identified as being more predictive for future disability progression than the treatment or relapses history. Conclusions: Good discrimination and calibration performance on an external validation set is achieved, using only routinely collected variables. This suggests machine-learning models can reliably inform clinicians about the future occurrence of progression and are mature for a clinical impact study.
Evaluation of machine learning-based classification of clinical impairment and prediction of clinical worsening in multiple sclerosis

Samantha Noteboom,Moritz Seiler,Claudia Chien,Roshan P. Rane,Frederik Barkhof,Eva M. M. Strijbis,Friedemann Paul,Menno M. Schoonheim,Kerstin Ritter

DOI: https://doi.org/10.1007/s00415-024-12507-w

2024-06-24

Journal of Neurology

Abstract:Background Robust predictive models of clinical impairment and worsening in multiple sclerosis (MS) are needed to identify patients at risk and optimize treatment strategies. Objective To evaluate whether machine learning (ML) methods can classify clinical impairment and predict worsening in people with MS (pwMS) and, if so, which combination of clinical and magnetic resonance imaging (MRI) features and ML algorithm is optimal. Methods We used baseline clinical and structural MRI data from two MS cohorts (Berlin: n = 125, Amsterdam: n = 330) to evaluate the capability of five ML models in classifying clinical impairment at baseline and predicting future clinical worsening over a follow-up of 2 and 5 years. Clinical worsening was defined by increases in the Expanded Disability Status Scale (EDSS), Timed 25-Foot Walk Test (T25FW), 9-Hole Peg Test (9HPT), or Symbol Digit Modalities Test (SDMT). Different combinations of clinical and volumetric MRI measures were systematically assessed in predicting clinical outcomes. ML models were evaluated using Monte Carlo cross-validation, area under the curve (AUC), and permutation testing to assess significance. Results The ML models significantly determined clinical impairment at baseline for the Amsterdam cohort, but did not reach significance for predicting clinical worsening over a follow-up of 2 and 5 years. High disability (EDSS ≥ 4) was best determined by a support vector machine (SVM) classifier using clinical and global MRI volumes (AUC = 0.83 ± 0.07, p = 0.015). Impaired cognition (SDMT Z -score ≤ −1.5) was best determined by a SVM using regional MRI volumes (thalamus, ventricles, lesions, and hippocampus), reaching an AUC of 0.73 ± 004 ( p = 0.008). Conclusion ML models could aid in classifying pwMS with clinical impairment and identify relevant biomarkers, but prediction of clinical worsening is an unmet need.

clinical neurology
Predicting multiple sclerosis disease progression and outcomes with machine learning and MRI-based biomarkers: a review

Hibba Yousef,Brigitta Malagurski Tortei,Filippo Castiglione

DOI: https://doi.org/10.1007/s00415-024-12651-3

2024-09-13

Journal of Neurology

Abstract:Multiple sclerosis (MS) is a demyelinating neurological disorder with a highly heterogeneous clinical presentation and course of progression. Disease-modifying therapies are the only available treatment, as there is no known cure for the disease. Careful selection of suitable therapies is necessary, as they can be accompanied by serious risks and adverse effects such as infection. Magnetic resonance imaging (MRI) plays a central role in the diagnosis and management of MS, though MRI lesions have displayed only moderate associations with MS clinical outcomes, known as the clinico-radiological paradox. With the advent of machine learning (ML) in healthcare, the predictive power of MRI can be improved by leveraging both traditional and advanced ML algorithms capable of analyzing increasingly complex patterns within neuroimaging data. The purpose of this review was to examine the application of MRI-based ML for prediction of MS disease progression. Studies were divided into five main categories: predicting the conversion of clinically isolated syndrome to MS, cognitive outcome, EDSS-related disability, motor disability and disease activity. The performance of ML models is discussed along with highlighting the influential MRI-derived biomarkers. Overall, MRI-based ML presents a promising avenue for MS prognosis. However, integration of imaging biomarkers with other multimodal patient data shows great potential for advancing personalized healthcare approaches in MS.

clinical neurology
Machine Learning Algorithms for Early Prediction of Multiple Sclerosis Progression: A Comparative Study

Kamel-Dine Haouam,Mourad Benmalek

DOI: https://doi.org/10.54364/aaiml.2024.41116

2024-01-01

Advances in Artificial Intelligence and Machine Learning

Abstract:Multiple Sclerosis (MS) is a chronic autoimmune disease characterized by central nervous system (CNS) degeneration, leading to diverse neurological symptoms. Managing MS poses a challenge due to its unpredictable progression. This study focuses on early prediction of MS progression using machine learning (ML) algorithms, comparing the effectiveness of Random Forest, XGBoost, Decision Tree, and Logistic Regression. Clinical, genetic, and environmental factors were analyzed in a cohort of Mexican mestizo patients recently diagnosed with Clinically Isolated Syndrome (CIS). Data preprocessing addressed missing values, and feature selection tailored to the population’s characteristics was applied. The dataset was split into training and testing sets, maintaining stratification for CDMS and nonCDMS cases. Machine learning models were trained with optimized hyperparameters. Performance evaluation metrics, including accuracy, precision, recall, F1-score, and AUC-ROC, were employed. The Random Forest model exhibited superior performance (AUC: 0.93, accuracy: 87%), outperforming other models. Variable importance analysis identified top predictors, including Periventricular MRI, Age, Infratentorial MRI, and Oligoclonal Bands. The study’s clinical implications highlight ML’s potential in enhancing early MS prognosis, aiding timely interventions. The Random Forest model, with its robust performance, emerges as a valuable tool for identifying patients at risk. While the study contributes to predictive analytics in neurological disorders, limitations include cohort specificity and retrospective data use. Prospective studies and further exploration of data sources are recommended for broader applicability. This research demonstrates the efficacy of ML in early MS progression prediction, providing clinicians with a promising tool for personalized patient care. The findings contribute to advancing predictive healthcare analytics and emphasize the significance of tailored interventions in neurological disorders.
Disability prediction in multiple sclerosis using performance outcome measures and demographic data

Subhrajit Roy,Diana Mincu,Lev Proleev,Negar Rostamzadeh,Chintan Ghate,Natalie Harris,Christina Chen,Jessica Schrouff,Nenad Tomasev,Fletcher Lee Hartsell,Katherine Heller

DOI: https://doi.org/10.48550/arXiv.2204.03969

2022-04-08

Abstract:Literature on machine learning for multiple sclerosis has primarily focused on the use of neuroimaging data such as magnetic resonance imaging and clinical laboratory tests for disease identification. However, studies have shown that these modalities are not consistent with disease activity such as symptoms or disease progression. Furthermore, the cost of collecting data from these modalities is high, leading to scarce evaluations. In this work, we used multi-dimensional, affordable, physical and smartphone-based performance outcome measures (POM) in conjunction with demographic data to predict multiple sclerosis disease progression. We performed a rigorous benchmarking exercise on two datasets and present results across 13 clinically actionable prediction endpoints and 6 machine learning models. To the best of our knowledge, our results are the first to show that it is possible to predict disease progression using POMs and demographic data in the context of both clinical trials and smartphone-base studies by using two datasets. Moreover, we investigate our models to understand the impact of different POMs and demographics on model performance through feature ablation studies. We also show that model performance is similar across different demographic subgroups (based on age and sex). To enable this work, we developed an end-to-end reusable pre-processing and machine learning framework which allows quicker experimentation over disparate MS datasets.

Machine Learning
Collaboration between a human group and artificial intelligence can improve prediction of multiple sclerosis course: a proof-of-principle study

Andrea Tacchella,Silvia Romano,Michela Ferraldeschi,Marco Salvetti,Andrea Zaccaria,Andrea Crisanti,Francesca Grassi

DOI: https://doi.org/10.12688/f1000research.13114.2

2018-08-01

F1000Research

Abstract:Background: Multiple sclerosis has an extremely variable natural course. In most patients, disease starts with a relapsing-remitting (RR) phase, which proceeds to a secondary progressive (SP) form. The duration of the RR phase is hard to predict, and to date predictions on the rate of disease progression remain suboptimal. This limits the opportunity to tailor therapy on an individual patient's prognosis, in spite of the choice of several therapeutic options. Approaches to improve clinical decisions, such as collective intelligence of human groups and machine learning algorithms are widely investigated. Methods: Medical students and a machine learning algorithm predicted the course of disease on the basis of randomly chosen clinical records of patients that attended at the Multiple Sclerosis service of Sant'Andrea hospital in Rome. Results: A significant improvement of predictive ability was obtained when predictions were combined with a weight that depends on the consistence of human (or algorithm) forecasts on a given clinical record. Conclusions: In this work we present proof-of-principle that human-machine hybrid predictions yield better prognoses than machine learning algorithms or groups of humans alone. To strengthen and generalize this preliminary result, we propose a crowdsourcing initiative to collect prognoses by physicians on an expanded set of patients.
Global and Regional Deep Learning Models for Multiple Sclerosis Stratification From MRI

Llucia Coll,Deborah Pareto,Pere Carbonell-Mirabent,Álvaro Cobo-Calvo,Georgina Arrambide,Ángela Vidal-Jordana,Manuel Comabella,Joaquín Castilló,Breogán Rodrı Guez-Acevedo,Ana Zabalza,Ingrid Galán,Luciana Midaglia,Carlos Nos,Cristina Auger,Manel Alberich,Jordi Río,Jaume Sastre-Garriga,Arnau Oliver,Xavier Montalban,Àlex Rovira,Mar Tintoré,Xavier Lladó,Carmen Tur

DOI: https://doi.org/10.1002/jmri.29046

Abstract:Background: The combination of anatomical MRI and deep learning-based methods such as convolutional neural networks (CNNs) is a promising strategy to build predictive models of multiple sclerosis (MS) prognosis. However, studies assessing the effect of different input strategies on model's performance are lacking. Purpose: To compare whole-brain input sampling strategies and regional/specific-tissue strategies, which focus on a priori known relevant areas for disability accrual, to stratify MS patients based on their disability level. Study type: Retrospective. Subjects: Three hundred nineteen MS patients (382 brain MRI scans) with clinical assessment of disability level performed within the following 6 months (~70% training/~15% validation/~15% inference in-house dataset) and 440 MS patients from multiple centers (independent external validation cohort). Field strength/sequence: Single vendor 1.5 T or 3.0 T. Magnetization-Prepared Rapid Gradient-Echo and Fluid-Attenuated Inversion Recovery sequences. Assessment: A 7-fold patient cross validation strategy was used to train a 3D-CNN to classify patients into two groups, Expanded Disability Status Scale score (EDSS) ≥ 3.0 or EDSS < 3.0. Two strategies were investigated: 1) a global approach, taking the whole brain volume as input and 2) regional approaches using five different regions-of-interest: white matter, gray matter, subcortical gray matter, ventricles, and brainstem structures. The performance of the models was assessed in the in-house and the independent external cohorts. Statistical tests: Balanced accuracy, sensitivity, specificity, area under receiver operating characteristic (ROC) curve (AUC). Results: With the in-house dataset, the gray matter regional model showed the highest stratification accuracy (81%), followed by the global approach (79%). In the external dataset, without any further retraining, an accuracy of 72% was achieved for the white matter model and 71% for the global approach. Data conclusion: The global approach offered the best trade-off between internal performance and external validation to stratify MS patients based on accumulated disability. Evidence level: 4 TECHNICAL EFFICACY: Stage 2.
The ambulatory clinic in a teaching hospital.

D. L. Wilson

1968-04-27

Canadian Medical Association Journal

Abstract:FROM an academic viewpoint, the outpatient department of a typical teaching hospital has not been "where the action is". It has functioned under a formidable list of handicaps. Its patients have generally been medically in¬ digent, without reasonable alternative sources of medical care, and have presented themselves in large numbers. A teaching hospital cannot ignore service to patients. Indeed, it must be prepared to give exemplary service, because the reason for its existence is to teach undergradu¬ ate and graduate students of medicine to provide such service. But if a teaching hospital, or a part of a teaching hospital, is service-oriented to the extent that it cannot control the number of patients within the limits its teachers consider optimal for educational purposes, the institution is doomed from the start. There have also been other difficulties. The outpatient department was apt to have insufficient money to provide optimal care for its patients, and in making the best possible compromises to provide maximal service to the most patients for the least money, it almost inevitably created an unpleasant and crowded environment. This repelled the patient and discouraged and frustrated even the most dedicated clinical teacher and his students. Cer¬ tainly the clinical teacher could scarcely make the outpatient clinic his base of operations, for he was unlikely to bring his private patients there. All in all, it is fair to say that an outpatient teaching appointment has not been regarded as an academic plum; and the embryo academic physician or surgeon might be forgiven if he looked upon such an appointment as a bit of white water he had to shoot before he could reach the quiet, deep and academically satisfying waters of an in-patient service of his own. Inevitably, some secondary problems, which
Multimodal-neuroimaging machine-learning analysis of motor disability in multiple sclerosis

Barbora Rehák Bučková,Jan Mareš,Antonín Škoch,Jakub Kopal,Jaroslav Tintěra,Robert Dineen,Kamila Řasová,Jaroslav Hlinka

DOI: https://doi.org/10.1007/s11682-022-00737-3

2022-11-19

Brain Imaging and Behavior

Abstract:Motor disability is a dominant and restricting symptom in multiple sclerosis, yet its neuroimaging correlates are not fully understood. We apply statistical and machine learning techniques on multimodal neuroimaging data to discriminate between multiple sclerosis patients and healthy controls and to predict motor disability scores in the patients. We examine the data of sixty-four multiple sclerosis patients and sixty-five controls, who underwent the MRI examination and the evaluation of motor disability scales. The modalities used comprised regional fractional anisotropy, regional grey matter volumes, and functional connectivity. For analysis, we employ two approaches: high-dimensional support vector machines run on features selected by Fisher Score (aiming for maximal classification accuracy), and low-dimensional logistic regression on the principal components of data (aiming for increased interpretability). We apply analogous regression methods to predict symptom severity. While fractional anisotropy provides the classification accuracy of 96.1% and 89.9% with both approaches respectively, including other modalities did not bring further improvement. Concerning the prediction of motor impairment, the low-dimensional approach performed more reliably. The first grey matter volume component was significantly correlated (R = 0.28-0.46, p < 0.05) with most clinical scales. In summary, we identified the relationship between both white and grey matter changes and motor impairment in multiple sclerosis. Furthermore, we were able to achieve the highest classification accuracy based on quantitative MRI measures of tissue integrity between patients and controls yet reported, while also providing a low-dimensional classification approach with comparable results, paving the way to interpretable machine learning models of brain changes in multiple sclerosis.

neuroimaging
An analytical review on the use of artificial intelligence and machine learning in diagnosis, prediction, and risk factor analysis of multiple sclerosis

Shima Pilehvari,Yasser Morgan,Wei Peng

DOI: https://doi.org/10.1016/j.msard.2024.105761

Abstract:Medical research offers potential for disease prediction, like Multiple Sclerosis (MS). This neurological disorder damages nerve cell sheaths, with treatments focusing on symptom relief. Manual MS detection is time-consuming and error prone. Though MS lesion detection has been studied, limited attention has been paid to clinical analysis and computational risk factor prediction. Artificial intelligence (AI) techniques and Machine Learning (ML) methods offer accurate and effective alternatives to mapping MS progression. However, there are challenges in accessing clinical data and interdisciplinary collaboration. By analyzing 103 papers, we recognize the trends, strengths and weaknesses of AI, ML, and statistical methods applied to MS diagnosis. AI/ML-based approaches are suggested to identify MS risk factors, select significant MS features, and improve the diagnostic accuracy, such as Rule-based Fuzzy Logic (RBFL), Adaptive Fuzzy Inference System (ANFIS), Artificial Neural Network methods (ANN), Support Vector Machine (SVM), and Bayesian Networks (BNs). Meanwhile, applications of the Expanded Disability Status Scale (EDSS) and Magnetic Resonance Imaging (MRI) can enhance MS diagnostic accuracy. By examining established risk factors like obesity, smoking, and education, some research tackled the issue of disease progression. The performance metrics varied across different aspects of MS studies: Diagnosis: Sensitivity ranged from 60 % to 98 %, specificity from 60 % to 98 %, and accuracy from 61 % to 97 %. Prediction: Sensitivity ranged from 76 % to 98 %, specificity from 65 % to 98 %, and accuracy from 62 % to 99 %. Segmentation: Accuracy ranged up to 96.7 %. Classification: Sensitivity ranged from 78 % to 97.34 %, specificity from 65 % to 99.32 %, and accuracy from 71 % to 97.94 %. Furthermore, the literature shows that combining techniques can improve efficiency, exploiting their strengths for better overall performance.
Interpretable and Intuitive Machine Learning Approaches for Predicting Disability Progression in Relapsing-Remitting Multiple Sclerosis Based on Clinical and Gray Matter Atrophy Indicators

Zichun Yan,Zhuowei Shi,Qiyuan Zhu,Jinzhou Feng,Yaou Liu,Yuxin Li,Fuqing Zhou,Zhizheng Zhuo,Shuang Ding,Xiaohua Wang,Feiyue Yin,Yang Tang,Bing Lin,Yongmei Li

DOI: https://doi.org/10.1016/j.acra.2024.01.032

IF: 5.482

2024-03-02

Academic Radiology

Abstract:Rationale and Objectives To investigate whether clinical and gray matter (GM) atrophy indicators can predict disability in relapsing-remitting multiple sclerosis (RRMS) and to enhance the interpretability and intuitiveness of a predictive machine learning model. Materials and methods 145 and 50 RRMS patients with structural MRI and at least 1-year follow-up Expanded Disability Status Scale (EDSS) results were retrospectively enrolled and placed in the discovery and external test cohorts, respectively. Six clinical and radiomics feature-based machine learning classifiers were trained and tested to predict disability progression in the discovery cohort and validated in the external test set. Partial dependence plot (PDP) analysis and a Shiny web application were conducted to enhance the interpretability and intuitiveness. Results In the discovery cohort, 98 patients had disability stability, and 47 patients were classified as having disability progression. In the external test set, 35 patients were disability stable, and 15 patients had disability progression. Models trained with both clinical and radiomics features (area under the curve (AUC), 0.725–0.950) outperformed those trained with clinical (AUC, 0.600–0.740) or radiomics features only (AUC, 0.615–0.945). Among clinical + radiomics feature models, the logistic regression (LR) classifier-based model performed best, with an AUC of 0.950. Only the radiomics feature-only models were applied in the external test set due to the data collection problem and showed fair performance, with AUCs ranging from 0.617 to 0.753. PDP analysis showed that female patients and those with lower volume, surface area, and symbol digit modalities test (SDMT) scores; greater mean curvature and age; and no disease modifying therapy (DMT) had increased probabilities of disease progression. Finally, a Shiny web application ( https://lauralin1104.shinyapps.io/LRshiny/ ) was developed to calculate the risk of disability progression. Conclusion Interpretable and intuitive machine learning approaches based on clinical and GM atrophy indicators can help physicians predict disability progression in RRMS patients for clinical decision-making and patient management.

radiology, nuclear medicine & medical imaging
Cortical lesions, central vein sign, and paramagnetic rim lesions in multiple sclerosis: emerging machine learning techniques and future avenues

Francesco La Rosa,Maxence Wynen,Omar Al-Louzi,Erin S Beck,Till Huelnhagen,Pietro Maggi,Jean-Philippe Thiran,Tobias Kober,Russell T Shinohara,Pascal Sati,Daniel S Reich,Cristina Granziera,Martina Absinta,Meritxell Bach Cuadra

DOI: https://doi.org/10.48550/arXiv.2201.07463

2022-01-19

Abstract:The current multiple sclerosis (MS) diagnostic criteria lack specificity, and this may lead to misdiagnosis, which remains an issue in present-day clinical practice. In addition, conventional biomarkers only moderately correlate with MS disease progression. Recently, advanced MS lesional imaging biomarkers such as cortical lesions (CL), the central vein sign (CVS), and paramagnetic rim lesions (PRL), visible in specialized magnetic resonance imaging (MRI) sequences, have shown higher specificity in differential diagnosis. Moreover, studies have shown that CL and PRL are potential prognostic biomarkers, the former correlating with cognitive impairments and the latter with early disability progression. As machine learning-based methods have achieved extraordinary performance in the assessment of conventional imaging biomarkers, such as white matter lesion segmentation, several automated or semi-automated methods have been proposed for CL, CVS, and PRL as well. In the present review, we first introduce these advanced MS imaging biomarkers and their imaging methods. Subsequently, we describe the corresponding machine learning-based methods that were used to tackle these clinical questions, putting them into context with respect to the challenges they are still facing, including non-standardized MRI protocols, limited datasets, and moderate inter-rater variability. We conclude by presenting the current limitations that prevent their broader deployment and suggesting future research directions.

Image and Video Processing,Machine Learning
Machine learning-driven diagnosis of multiple sclerosis from whole blood transcriptomics

Maryam Omrani,Rosaria Rita Chiarelli,Massimo Acquaviva,Claudia Bassani,Gloria Dalla Costa,Federico Montini,Paolo Preziosa,Lucia Pagani,Francesca Grassivaro,Simone Guerrieri,Marzia Romeo,Francesca Sangalli,Bruno Colombo,Lucia Moiola,Mauro Zaffaroni,Anna Pietroboni,Alessandra Protti,Marco Puthenparampil,Roberto Bergamaschi,Giancarlo Comi,Maria A Rocca,Vittorio Martinelli,Massimo Filippi,Cinthia Farina

DOI: https://doi.org/10.1016/j.bbi.2024.07.039

2024-08-01

Abstract:Multiple sclerosis (MS) is a neurological disorder characterized by immune dysregulation. It begins with a first clinical manifestation, a clinically isolated syndrome (CIS), which evolves to definite MS in case of further clinical and/or neuroradiological episodes. Here we evaluated the diagnostic value of transcriptional alterations in MS and CIS blood by machine learning (ML). Deep sequencing of more than 200 blood RNA samples comprising CIS, MS and healthy subjects, generated transcriptomes that were analyzed by the binary classification workflow to distinguish MS from healthy subjects and the Time-To-Event pipeline to predict CIS conversion to MS along time. To identify optimal classifiers, we performed algorithm benchmarking by nested cross-validation with the train set in both pipelines and then tested models generated with the train set on an independent dataset for final validation. The binary classification model identified a blood transcriptional signature classifying definite MS from healthy subjects with 97% accuracy, indicating that MS is associated with a clear predictive transcriptional signature in blood cells. When analyzing CIS data with ML survival models, prediction power of CIS conversion to MS was about 72% when using paraclinical data and 74.3% when using blood transcriptomes, indicating that blood-based classifiers obtained at the first clinical event can efficiently predict risk of developing MS. Coupling blood transcriptomics with ML approaches enables retrieval of predictive signatures of CIS conversion and MS state, thus introducing early non-invasive approaches to MS diagnosis.
Multiscale networks in multiple sclerosis

Keith E. Kennedy,Nicole Kerlero de Rosbo,Antonio Uccelli,Maria Cellerino,Federico Ivaldi,Paola Contini,Raffaele De Palma,Hanne F. Harbo,Tone Berge,Steffan D. Bos,Einar A. Høgestøl,Synne Brune-Ingebretsen,Sigrid A. de Rodez Benavent,Friedemann Paul,Alexander U. Brandt,Priscilla Bäcker-Koduah,Janina Behrens,Joseph Kuchling,Susanna Asseyer,Michael Scheel,Claudia Chien,Hanna Zimmermann,Seyedamirhosein Motamedi,Josef Kauer-Bonin,Julio Saez-Rodriguez,Melanie Rinas,Leonidas G. Alexopoulos,Magi Andorra,Sara Llufriu,Albert Saiz,Yolanda Blanco,Eloy Martinez-Heras,Elisabeth Solana,Irene Pulido-Valdeolivas,Elena H. Martinez-Lapiscina,Jordi Garcia-Ojalvo,Pablo Villoslada

DOI: https://doi.org/10.1371/journal.pcbi.1010980

2024-02-09

PLoS Computational Biology

Abstract:Complex diseases such as Multiple Sclerosis (MS) cover a wide range of biological scales, from genes and proteins to cells and tissues, up to the full organism. In fact, any phenotype for an organism is dictated by the interplay among these scales. We conducted a multilayer network analysis and deep phenotyping with multi-omics data (genomics, phosphoproteomics and cytomics), brain and retinal imaging, and clinical data, obtained from a multicenter prospective cohort of 328 patients and 90 healthy controls. Multilayer networks were constructed using mutual information for topological analysis, and Boolean simulations were constructed using Pearson correlation to identified paths within and among all layers. The path more commonly found from the Boolean simulations connects protein MK03, with total T cells, the thickness of the retinal nerve fiber layer (RNFL), and the walking speed. This path contains nodes involved in protein phosphorylation, glial cell differentiation, and regulation of stress-activated MAPK cascade, among others. Specific paths identified were subsequently analyzed by flow cytometry at the single-cell level. Combinations of several proteins (GSK3AB, HSBP1 or RS6) and immune cells (Th17, Th1 non-classic, CD8, CD8 Treg, CD56 neg, and B memory) were part of the paths explaining the clinical phenotype. The advantage of the path identified from the Boolean simulations is that it connects information about these known biological pathways with the layers at higher scales (retina damage and disability). Overall, the identified paths provide a means to connect the molecular aspects of MS with the overall phenotype. Complex diseases such as Multiple Sclerosis (MS) involve the contribution of a wide range of biological processes. We conducted a systems biology study of MS based on network analysis and deep phenotyping in a prospective cohort of patients with clinical, imaging, genetics, and omics assessments. The genes, proteins and cell paths explained variation in central nervous system damage, and in metrics of disease severity. Such multilayer paths explain the different phenotypes of the disease and can be developed as biomarkers of MS.

biochemical research methods,mathematical & computational biology
Ensemble Learning for Multiple Sclerosis Disability Estimation Using Brain Structural Connectivity

Berardino Barile,Aldo Marzullo,Claudio Stamile,Françoise Durand-Dubief,Dominique Sappey-Marinier

DOI: https://doi.org/10.1089/brain.2020.1003

Abstract:Background: Multiple sclerosis (MS) is an autoimmune inflammatory disease of the central nervous system characterized by demyelination and neurodegeneration processes. It leads to different clinical courses and degrees of disability that need to be anticipated by the neurologist for personalized therapy. Recently, machine learning (ML) techniques have reached a high level of performance in brain disease diagnosis and/or prognosis, but the decision process of a trained ML system is typically nontransparent. Using brain structural connectivity data, a fully automatic ensemble learning model, augmented with an interpretable model, is proposed for the estimation of MS patients' disability, measured by the Expanded Disability Status Scale (EDSS). Materials and Methods: An ensemble of four boosting-based models (GBM, XGBoost, CatBoost, and LightBoost) organized following a stacking generalization scheme was developed using diffusion tensor imaging (DTI)-based structural connectivity data. In addition, an interpretable model based on conditional logistic regression was developed to explain the best performances in terms of white matter (WM) links for three classes of EDSS (low, medium, and high). Results: The ensemble model reached excellent level of performance (root mean squared error of 0.92 ± 0.28) compared with single-based models and provided a better EDSS estimation using DTI-based structural connectivity data compared with conventional magnetic resonance imaging measures associated with patient data (age, gender, and disease duration). Used for interpretation of the estimation process, the counterfactual method showed the importance of certain brain networks, corresponding mainly to left hemisphere WM links, connecting the left superior temporal with the left posterior cingulate and the right precuneus gray matter regions, and the interhemispheric WM links constituting the corpus callosum. Also, a better accuracy estimation was found for the high disability class. Conclusion: The combination of advanced ML models and sensitive techniques such as DTI-based structural connectivity demonstrated to be useful for the estimation of MS patients' disability and to point out the most important brain WM networks involved in disability. Impact statement An ensemble of "boosting" machine learning (ML) models was more performant than single models to estimate disability in multiple sclerosis. Diffusion tensor imaging (DTI)-based structural connectivity led to better performance than conventional magnetic resonance imaging. An interpretable model, based on counterfactual perturbation, highlighted the most relevant white matter fiber links for disability estimation. These findings demonstrated the clinical interest of combining DTI, graph modeling, and ML techniques.
Biological Dosimetry for Epithermal Neutron Beams

S. M. White,K. Held,M. Palmer,J. Yanch

DOI: https://doi.org/10.1667/0033-7587(2001)155[0778:BDFENB]2.0.CO;2

2001-06-01

Radiation Research

Abstract:Abstract White, S. M., Held, K. D., Palmer, M. R. and Yanch, J. C. Biological Dosimetry for Epithermal Neutron Beams. Radiat. Res. 155, 776–782 (2001). The radiobiological effectiveness of an epithermal neutron beam is described using cell survival as the end point. The M67 epithermal neutron beam at the Nuclear Reactor Laboratory, Massachusetts Institute of Technology, that was used for clinical trials of boron neutron capture therapy was used to irradiate Chinese hamster ovary cells at seven depths in a water-filled phantom that simulated healthy tissue. No boron was added to the samples. Therefore, this experiment evaluates the biological effectiveness of the neutron and photon components, which comprise 80–95% of the dose to healthy tissue. Cell survival was dependent upon the depth in the phantom, as a result of moderation and attenuation of the epithermal neutron beam components by the overlying water. The results were compared with 250 kVp X irradiations to determine relative biological effectiveness values. Cell survival as a function of the dose delivered was lowest at the most shallow depth of 0.5 cm, and increased at depths of 1.5, 3, 4, 5.6, 6.6 and 8.1 cm. The gradual increase in cell survival with increasing depth in the phantom is due to the exponential drop of the fast-neutron intensity of the beam. These results are applicable to clinical boron neutron capture therapy Phase I/II trials in which healthy tissue toxicity was an end point.
Machine learning in secondary progressive multiple sclerosis: an improved predictive model for short-term disability progression

Marco TK Law,Anthony L Traboulsee,David KB Li,Robert L Carruthers,Mark S Freedman,Shanon H Kolind,Roger Tam,Shannon H Kolind

DOI: https://doi.org/10.1177/2055217319885983

2019-10-01

Abstract:BACKGROUND: Enhanced prediction of progression in secondary progressive multiple sclerosis (SPMS) could improve clinical trial design. Machine learning (ML) algorithms are methods for training predictive models with minimal human intervention.OBJECTIVE: To evaluate individual and ensemble model performance built using decision tree (DT)-based algorithms compared to logistic regression (LR) and support vector machines (SVMs) for predicting SPMS disability progression.METHODS: SPMS participants (<i>n</i> = 485) enrolled in a 2-year placebo-controlled (negative) trial assessing the efficacy of MBP8298 were classified as progressors if a 6-month sustained increase in Expanded Disability Status Scale (EDSS) (≥1.0 or ≥0.5 for a baseline of ≤5.5 or ≥6.0 respectively) was observed. Variables included EDSS, Multiple Sclerosis Functional Composite component scores, T2 lesion volume, brain parenchymal fraction, disease duration, age, and sex. Area under the receiver operating characteristic curve (AUC) was the primary outcome for model evaluation.RESULTS: Three DT-based models had greater AUCs (61.8%, 60.7%, and 60.2%) than independent and ensemble SVM (52.4% and 51.0%) and LR (49.5% and 51.1%).CONCLUSION: SPMS disability progression was best predicted by non-parametric ML. If confirmed, ML could select those with highest progression risk for inclusion in SPMS trial cohorts and reduce the number of low-risk individuals exposed to experimental therapies.
Evaluation of machine learning algorithms using OCT and OCT angiography for the diagnosis of multiple sclerosis

María Pilar Rojas Lozano,Pablo García Mesa,Nuria Díaz Gutiérrez,Juan José Gómez Valverde

DOI: https://doi.org/10.1111/aos.16095

2024-01-01

Acta Ophthalmologica

Abstract:Aims/Purpose: We present a comprehensive evaluation of machine learning (ML) algorithms using Optical coherence tomography (OCT) and optical coherence tomography angiography (OCT‐A) for the diagnosis of Multiple sclerosis (MS). Methods: Prospective observational study using OCT volumes acquired with Cirrus HD‐OCT 5000 (Carl Zeiss, Meditec, Dublin, CA, EEUU) using the scanning protocols Optic Disc Cube 200 × 200 and Macular Cube 512 × 128, and OCT‐A macular volumes 175 × 350 with FOV 6 × 6 mm and OCT‐A of the Optic Nerve Head (ONH) with FOV 4.5 × 4.5 mm. The total data set consisted of 79 eyes of 40 patients with MS and 54 eyes of 27 control subjects. We evaluated classification algorithms such as Support Vector Machines, k‐Nearest Neighbour, Decision Trees, Random Forest, Extra Trees Classifier and Gaussian NB using data extracted from Ganglion Cell Analysis (8 parameters), Macular Thickness Analysis (7 parameters) and Optic Disc Analysis (5 parameters) from the OCT volumes and 5 parameters from the analysis of the macular OCT‐A volumes and 6 parameters from the analysis of the ONH. We studied all the ML algorithms considering three scenarios: OCT (20 parameters), OCT‐A (11 parameters), and OCT + OCT‐A (31 parameters). The models were trained using a 5‐fold cross‐validation strategy. We calculated the accuracy, F1‐score for each model and the area under the curve (AUC) was used to select the best ML algorithm. We applied SHAP (SHapley Additive exPlanations) to explain the output of the best ML model. Results: For the MS diagnosis, the best results were obtained for OCT with Gaussian NB (accuracy 0.865 ± 0.085, F1‐score 0.864 ± 0.086 and AUC 0.871 ± 0.081), for OCT‐A with Random Forest (accuracy 0.832 ± 0.032, F1‐score 0.832 ± 0.043 and AUC 0.831 ± 0.043) and for OCT + OCT‐A with Gaussian NB (accuracy 0.885 ± 0.028, F1‐score 0.886 ± 0.028 and AUC 0.891 ± 0.034). The input parameters with the highest contribution to the model's predictions were the minimum ganglion cell thickness and the temporal flow index in the ETDRS grid. Conclusions: This study highlights the efficacy of machine learning techniques in utilizing combined parameters from OCT and OCT‐A images of the macula and ONH tests to facilitate early diagnosis of MS. Moreover, it underscores the significance of ophthalmic examination in the comprehensive management of the disease.

ophthalmology
Machine learning methods applied to classify complex diseases using genomic data

Magdalena Arnal Segura,Giorgio Bini,Anastasia Krithara,George Paliouras,Gian Gaetano Tartaglia

DOI: https://doi.org/10.1101/2024.03.18.585541

2024-03-20

Abstract:Complex diseases pose challenges in disease prediction due to their multifactorial and polygenic nature. In this work, we explored the prediction of two complex diseases, multiple sclerosis (MS) and Alzheimer’s disease (AD), using machine learning (ML) methods and genomic data from UK Biobank. Different ML methods were applied, including logistic regressions (LR), gradient boosting decision trees (GB), extremely randomized trees (ET), random forest (RF), feedforward networks (FFN), and convolutional neural networks (CNN). The primary goal of this research was to investigate the variability of ML models in classifying complex diseases based on genomic risk. LR was the most robust method across folds and diseases, whereas deep learning methods (FFN and CNN) exhibited high variability. When comparing the performance of polygenic risk scores (PRS) with ML methods, PRS consistently performed at an average level. However, PRS still offers several practical advantages over ML methods. Despite implementing feature selection techniques to exclude non-informative and correlated predictors, the performance of ML models did not improve significantly, underscoring the ability of ML methods to achieve optimal performance even in the presence of correlated features due to linkage disequilibrium. Upon applying explainability tools to extract information about the genomic features contributing most to the classification task, the results confirmed the polygenicity of MS. The prevalence of HLA gene annotations among the top genomic features on chromosome 6 aligns with their significance in the context of MS. Overall, the highest-prioritized genomic variants were identified as expression or splicing quantitative trait loci (eQTL or sQTL) located in non-coding regions within or near genes associated with the immune response and MS. In summary, this research offers deeper insights into how ML models discern genomic patterns related to complex diseases.

Bioinformatics

SGR stalemate: hope fades for long-term solution from Congress.

Predicting multiple sclerosis disease severity with multimodal deep neural networks

Machine-learning-based prediction of disability progression in multiple sclerosis: An observational, international, multi-center study

Evaluation of machine learning-based classification of clinical impairment and prediction of clinical worsening in multiple sclerosis

Predicting multiple sclerosis disease progression and outcomes with machine learning and MRI-based biomarkers: a review

Machine Learning Algorithms for Early Prediction of Multiple Sclerosis Progression: A Comparative Study

Disability prediction in multiple sclerosis using performance outcome measures and demographic data

Collaboration between a human group and artificial intelligence can improve prediction of multiple sclerosis course: a proof-of-principle study

Global and Regional Deep Learning Models for Multiple Sclerosis Stratification From MRI

The ambulatory clinic in a teaching hospital.

Multimodal-neuroimaging machine-learning analysis of motor disability in multiple sclerosis

An analytical review on the use of artificial intelligence and machine learning in diagnosis, prediction, and risk factor analysis of multiple sclerosis

Interpretable and Intuitive Machine Learning Approaches for Predicting Disability Progression in Relapsing-Remitting Multiple Sclerosis Based on Clinical and Gray Matter Atrophy Indicators

Cortical lesions, central vein sign, and paramagnetic rim lesions in multiple sclerosis: emerging machine learning techniques and future avenues

Machine learning-driven diagnosis of multiple sclerosis from whole blood transcriptomics

Multiscale networks in multiple sclerosis

Ensemble Learning for Multiple Sclerosis Disability Estimation Using Brain Structural Connectivity

Biological Dosimetry for Epithermal Neutron Beams

Machine learning in secondary progressive multiple sclerosis: an improved predictive model for short-term disability progression

Evaluation of machine learning algorithms using OCT and OCT angiography for the diagnosis of multiple sclerosis

Machine learning methods applied to classify complex diseases using genomic data