Abstract:Background: Although machine learning is a promising tool for making prognoses, the performance of machine learning in predicting outcomes after stroke remains to be examined. Objective: This study aims to examine how much data-driven models with machine learning improve predictive performance for poststroke outcomes compared with conventional stroke prognostic scores and to elucidate how explanatory variables in machine learning-based models differ from the items of the stroke prognostic scores. Methods: We used data from 10,513 patients who were registered in a multicenter prospective stroke registry in Japan between 2007 and 2017. The outcomes were poor functional outcome (modified Rankin Scale score >2) and death at 3 months after stroke. Machine learning-based models were developed using all variables with regularization methods, random forests, or boosted trees. We selected 3 stroke prognostic scores, namely, ASTRAL (Acute Stroke Registry and Analysis of Lausanne), PLAN (preadmission comorbidities, level of consciousness, age, neurologic deficit), and iScore (Ischemic Stroke Predictive Risk Score) for comparison. Item-based regression models were developed using the items of these 3 scores. The model performance was assessed in terms of discrimination and calibration. To compare the predictive performance of the data-driven model with that of the item-based model, we performed internal validation after random splits of identical populations into 80% of patients as a training set and 20% of patients as a test set; the models were developed in the training set and were validated in the test set. We evaluated the contribution of each variable to the models and compared the predictors used in the machine learning-based models with the items of the stroke prognostic scores. Results: The mean age of the study patients was 73.0 (SD 12.5) years, and 59.1% (6209/10,513) of them were men. The area under the receiver operating characteristic curves and the area under the precision-recall curves for predicting poststroke outcomes were higher for machine learning-based models than for item-based models in identical populations after random splits. Machine learning-based models also performed better than item-based models in terms of the Brier score. Machine learning-based models used different explanatory variables, such as laboratory data, from the items of the conventional stroke prognostic scores. Including these data in the machine learning-based models as explanatory variables improved performance in predicting outcomes after stroke, especially poststroke death. Conclusions: Machine learning-based models performed better in predicting poststroke outcomes than regression models using the items of conventional stroke prognostic scores, although they required additional variables, such as laboratory data, to attain improved performance. Further studies are warranted to validate the usefulness of machine learning in clinical settings.

Stroke Prognostic Scores and Data-Driven Prediction of Clinical Outcomes After Acute Ischemic Stroke

Validating a Predictive Model of Acute Advanced Imaging Biomarkers in Ischemic Stroke

Predictive Performance of Machine Learning-Based Models for Poststroke Clinical Outcomes in Comparison With Conventional Prognostic Scores: Multicenter, Hospital-Based Observational Study

Prediction-Driven Decision Support for Patients With Mild Stroke: A Model Based on Machine Learning Algorithms

Prediction of Poststroke Depression Based on the Outcomes of Machine Learning Algorithms

Scoring Model To Predict Functional Outcome In Poor-Grade Aneurysmal Subarachnoid Hemorrhage

Development and Validation of a Novel Score for Predicting Long-Term Mortality after an Acute Ischemic Stroke

Prediction of Clinical Outcome in Patients with Large-Vessel Acute Ischemic Stroke: Performance of Machine Learning versus SPAN-100

A novel prediction score determining individual clinical outcome 3 months after juvenile stroke (PREDICT-score)

Natural Language Processing Enhances Prediction of Functional Outcome After Acute Ischemic Stroke

Development of a Prediction Model for 1-Year Poor Prognosis in Patients with Acute Ischemic Stroke.

Predicting 6-Month Unfavorable Outcome of Acute Ischemic Stroke Using Machine Learning

Using Machine Learning to Improve the Prediction of Functional Outcome in Ischemic Stroke Patients

Development and validation of a machine learning-based prognostic risk stratification model for acute ischemic stroke

Abstract TP278: Identifying High-Risk Patients With Poor Prognosis in Acute Phase of Ischemic Stroke: Treatment-Specific Risk Scales Developed From the National Neurological Medical Center of China

Using a Multiclass Machine Learning Model to Predict the Outcome of Acute Ischemic Stroke Requiring Reperfusion Therapy

Machine learning is an effective method to predict the 3-month prognosis of patients with acute ischemic stroke

Development and Validation of a Two-step Model to Predict Outcomes After Endovascular Treatment for Patients With Acute Ischemic Stroke

Abstract W P16: Comparing Outcome Prediction Scoring Systems in the Interventional Management of Stroke (IMS) III Trial: No Clear Winner

Inpatient stroke rehabilitation: prediction of clinical outcomes using a machine-learning approach

Machine Learning Models for Predicting Influential Factors of Early Outcomes in Acute Ischemic Stroke: Registry-Based Study