Development and validation of a random forest model to predict functional outcome in patients with intracerebral hemorrhage

Zhang, Yunzhou

DOI: https://doi.org/10.1007/s10072-023-06824-7

2023-05-11

Neurological Sciences

Abstract:To develop and validate a machine learning (ML)–based model to predict functional outcome in Chinese patients with intracerebral hemorrhage (ICH).

neurosciences,clinical neurology

What problem does this paper attempt to address?

Machine Learning-Based Approaches for Prediction of Patients’ Functional Outcome and Mortality after Spontaneous Intracerebral Hemorrhage

Rui Guo,Renjie Zhang,Ran Liu,Yi Liu,Hao Li,Lu Ma,Min He,Chao You,Rui Tian

DOI: https://doi.org/10.3390/jpm12010112

IF: 3.5083

2022-01-14

Journal of Personalized Medicine

Abstract:Spontaneous intracerebral hemorrhage (SICH) has been common in China with high morbidity and mortality rates. This study aims to develop a machine learning (ML)-based predictive model for the 90-day evaluation after SICH. We retrospectively reviewed 751 patients with SICH diagnosis and analyzed clinical, radiographic, and laboratory data. A modified Rankin scale (mRS) of 0–2 was defined as a favorable functional outcome, while an mRS of 3–6 was defined as an unfavorable functional outcome. We evaluated 90-day functional outcome and mortality to develop six ML-based predictive models and compared their efficacy with a traditional risk stratification scale, the intracerebral hemorrhage (ICH) score. The predictive performance was evaluated by the areas under the receiver operating characteristic curves (AUC). A total of 553 patients (73.6%) reached the functional outcome at the 3rd month, with the 90-day mortality rate of 10.2%. Logistic regression (LR) and logistic regression CV (LRCV) showed the best predictive performance for functional outcome (AUC = 0.890 and 0.887, respectively), and category boosting presented the best predictive performance for the mortality (AUC = 0.841). Therefore, ML might be of potential assistance in the prediction of the prognosis of SICH.

medicine, general & internal,health care sciences & services
Predicting Intraventricular Hemorrhage Growth with a Machine Learning-Based, Radiomics-Clinical Model

Dong -Qin Zhu,Qian Chen,Yi-Lan Xiang,Chen-Yi Zhan,Ming-Yue Zhang,Chao Chen,Qi- Chuan Zhuge,Wei-Jian Chen,Xiao-Ming Yang,Yun-Jun Yang

DOI: https://doi.org/10.18632/aging.202954

2021-01-01

Aging

Abstract:We constructed a radiomics-clinical model to predict intraventricular hemorrhage (IVH) growth after spontaneous intracerebral hematoma. The model was developed using a training cohort (N=626) and validated with an independent testing cohort (N=270). Radiomics features and clinical predictors were selected using the least absolute shrinkage and selection operator (LASSO) method and multivariate analysis. The radiomics score (Rad-score) was calculated through linear combination of selected features multiplied by their respective LASSO coefficients. The support vector machine (SVM) method was used to construct the model. IVH growth was experienced by 13.4% and 13.7% of patients in the training and testing cohorts, respectively. The Rad-score was associated with severe IVH and poor outcome. Independent predictors of IVH growth included hypercholesterolemia (odds ratio [OR], 0.12 [95%CI, 0.02-0.90]; p=0.039), baseline Graeb score (OR, 1.26 [95%CI, 1.16-1.36]; p<0.001), time to initial CT (OR, 0.70 [95%CI, 0.58-0.86]; p<0.001), international normalized ratio (OR, 4.27 [95%CI, 1.40, 13.0]; p=0.011), and Rad-score (OR, 2.3 [95%CI, 1.6-3.3]; p<0.001). In the training cohort, the model achieved an AUC of 0.78, sensitivity of 0.83, and specificity of 0.66. In the testing cohort, AUC, sensitivity, and specificity were 0.71, 0.81, and 0.64, respectively. This radiomics-clinical model thus has the potential to predict IVH growth.
Predicting the recurrence of spontaneous intracerebral hemorrhage using a machine learning model

Chaohua Cui,Jiaona Lan,Zhenxian Lao,Tianyu Xia,Tonghua Long

DOI: https://doi.org/10.3389/fneur.2024.1407014

IF: 3.4

2024-05-23

Frontiers in Neurology

Abstract:Background: Recurrence can worsen conditions and increase mortality in ICH patients. Predicting the recurrence risk and preventing or treating these patients is a rational strategy to improve outcomes potentially. A machine learning model with improved performance is necessary to predict recurrence. Methods: We collected data from ICH patients in two hospitals for our retrospective training cohort and prospective testing cohort. The outcome was the recurrence within one year. We constructed logistic regression, support vector machine (SVM), decision trees, Voting Classifier, random forest, and XGBoost models for prediction. Results: The model included age, NIHSS score at discharge, hematoma volume at admission and discharge, PLT, AST, and CRP levels at admission, use of hypotensive drugs and history of stroke. In internal validation, logistic regression demonstrated an AUC of 0.89 and precision of 0.81, SVM showed an AUC of 0.93 and precision of 0.90, the random forest achieved an AUC of 0.95 and precision of 0.93, and XGBoost scored an AUC of 0.95 and precision of 0.92. In external validation, logistic regression achieved an AUC of 0.81 and precision of 0.79, SVM obtained an AUC of 0.87 and precision of 0.76, the random forest reached an AUC of 0.92 and precision of 0.86, and XGBoost recorded an AUC of 0.93 and precision of 0.91. Conclusion: The machine learning models performed better in predicting ICH recurrence than traditional statistical models. The XGBoost model demonstrated the best comprehensive performance for predicting ICH recurrence in the external testing cohort.

neurosciences,clinical neurology
Causative Classification of Ischemic Stroke by the Machine Learning Algorithm Random Forests

Jianan Wang,Xiaoxian Gong,Hongfang Chen,Wansi Zhong,Yi Chen,Ying Zhou,Wenhua Zhang,Yaode He,Min Lou

DOI: https://doi.org/10.3389/fnagi.2022.788637

IF: 4.8

2022-01-01

Frontiers in Aging Neuroscience

Abstract:Background Prognosis, recurrence rate, and secondary prevention strategies differ by different etiologies in acute ischemic stroke. However, identifying its cause is challenging. Objective This study aimed to develop a model to identify the cause of stroke using machine learning (ML) methods and test its accuracy. Methods We retrospectively reviewed the data of patients who had determined etiology defined by the Trial of ORG 10172 in Acute Stroke Treatment (TOAST) from CASE-II (NCT04487340) to train and evaluate six ML models, namely, Random Forests (RF), Logistic Regression (LR), Extreme Gradient Boosting (XGBoost), K-Nearest Neighbor (KNN), Ada Boosting, Gradient Boosting Machine (GBM), for the detection of cardioembolism (CE), large-artery atherosclerosis (LAA), and small-artery occlusion (SAO). Between October 2016 and April 2020, patients were enrolled consecutively for algorithm development (phase one). Between June 2020 and December 2020, patients were enrolled consecutively in a test set for algorithm test (phase two). Area under the curve (AUC), precision, recall, accuracy, and F1 score were calculated for the prediction model. Results Finally, a total of 18,209 patients were enrolled in phase one, including 13,590 patients (i.e., 6,089 CE, 4,539 LAA, and 2,962 SAO) in the model, and a total of 3,688 patients were enrolled in phase two, including 3,070 patients (i.e., 1,103 CE, 1,269 LAA, and 698 SAO) in the model. Among the six models, the best models were RF, XGBoost, and GBM, and we chose the RF model as our final model. Based on the test set, the AUC values of the RF model to predict CE, LAA, and SAO were 0.981 (95%CI, 0.978–0.986), 0.919 (95%CI, 0.911–0.928), and 0.918 (95%CI, 0.908–0.927), respectively. The most important items to identify CE, LAA, and SAO were atrial fibrillation and degree of stenosis of intracranial arteries. Conclusion The proposed RF model could be a useful diagnostic tool to help neurologists categorize etiologies of stroke. Clinical Trial Registration [www.ClinicalTrials.gov], identifier [NCT01274117].
Prediction of large vessel occlusion for ischaemic stroke by using the machine learning model random forests

Jianan Wang,Jungen Zhang,Xiaoxian Gong,Wenhua Zhang,Ying Zhou,Min Lou

DOI: https://doi.org/10.1136/svn-2021-001096

IF: 5.9

2022-01-01

Stroke and Vascular Neurology

Abstract:Backgrounds The timely identification of large vessel occlusion (LVO) in the prehospital stage is extremely important given the disease morbidity and narrow time window for intervention. The current evaluation strategies still remain challenging. The goal of this study was to develop a machine learning (ML) model to predict LVO using prehospital accessible data. Methods Consecutive acute ischaemic stroke patients who underwent CT or MR angiography and received reperfusion therapy within 8 hours from symptom onset in the Computer-based Online Database of Acute Stroke Patients for Stroke Management Quality Evaluation-II dataset from January 2016 to August 2021 were included. We developed eight ML models to integrate National Institutes of Health Stroke Scale (NIHSS) items with demographics, medical history and vascular risk factors to identify LVO and validate its efficiency. Results Finally, 15365 patients were included in the training set and 4215 patients were included in the test set. On the test set, random forests (RE), gradient boosting machine and extreme gradient boosting presented area under the curve (AUC) of 0.831 (95% CI 0.819 to 0.843), which were higher than other models, and RE presented the highest specificity (0.827). In addition, the AUC of RF was higher than other scales, and the accuracy of the model was improved by 6.4% compared with NIHSS. We also found the top five items of identifying LVO were total NIHSS score, gaze deviation, level of consciousness (LOC), LOC commands and motor left leg. Conclusions Our proposed model could be a useful screening tool to predict LVO based on the prehospital accessible medical data.
Predicting the Outcome of Patients with Aneurysmal Subarachnoid Hemorrhage: A Machine-Learning-Guided Scorecard

Yi Zhang,Hanhai Zeng,Hang Zhou,Jingbo Li,Tingting Wang,Yinghan Guo,Lingxin Cai,Junwen Hu,Xiaotong Zhang,Gao Chen

DOI: https://doi.org/10.3390/jcm12227040

IF: 3.9

2023-01-01

Journal of Clinical Medicine

Abstract:Aneurysmal subarachnoid hemorrhage (aSAH) frequently causes long-term disability, but predicting outcomes remains challenging. Routine parameters such as demographics, admission status, CT findings, and blood tests can be used to predict aSAH outcomes. The aim of this study was to compare the performance of traditional logistic regression with several machine learning algorithms using readily available indicators and to generate a practical prognostic scorecard based on machine learning. Eighteen routinely available indicators were collected as outcome predictors for individuals with aSAH. Logistic regression (LR), random forest (RF), support vector machines (SVMs), and fully connected neural networks (FCNNs) were compared. A scorecard system was established based on predictor weights. The results show that machine learning models and a scorecard achieved 0.75 similar to 0.8 area under the curve (AUC) predicting aSAH outcomes (LR 0.739, RF 0.749, SVM 0.762 similar to 0.793, scorecard 0.794). FCNNs performed best (similar to 0.95) but lacked interpretability. The scorecard model used only five factors, generating a clinically useful tool with a total cutoff score of >= 5, indicating poor prognosis. We developed and validated machine learning models proven to predict outcomes more accurately in individuals with aSAH. The parameters found to be the most strongly predictive of outcomes were NLR, lymphocyte count, monocyte count, hypertension status, and SEBES. The scorecard system provides a simplified means of applying predictive analytics at the bedside using a few key indicators.
The Value of Machine Learning Models in Predicting Factors Associated with the Need for Permanent Shunting in Patients with Intracerebral Hemorrhage Requiring Emergency Cerebrospinal Fluid Diversion

Ehsan Alimohammadi,Seyed Reza Bagheri,Farid Moradi,Alireza Abdi,Michael T Lawton

DOI: https://doi.org/10.1016/j.wneu.2024.10.078

2024-11-13

Abstract:Objective: To assess the efficacy of machine learning models in identifying factors associated with the need for permanent ventricular shunt placement in patients experiencing intracerebral hemorrhage (ICH) who require emergency cerebrospinal fluid (CSF) diversion. Methods: A retrospective review was performed on patients with ICH requiring urgent CSF diversion who were admitted to our facility between July 2009 and May 2023. A binary logistic regression analysis was carried out to determine independent predictors linked to the development of shunt-dependent hydrocephalus following ICH. Five different machine learning models-random forest (RF), support vector machine (SVM), k-nearest neighbor (k-NN), logistic regression (LR), and Adaptive Boosting (AdaBoost)-were utilized to predict the need for permanent shunting in those with spontaneous ICH necessitating emergency CSF diversion. Additionally, RF techniques were applied to identify the factors affecting the need for permanent ventricular shunt placement in these patients. Results: A total of 578 patients were included in the analysis. Shunt-dependent hydrocephalus occurred in 121 individuals (20.9%). In the multivariate analysis, the Graeb Score, the length of time the external ventricular drain was in place, and an elevated intracranial pressure greater than 30 mm Hg were significant predictors for the need for permanent CSF diversion (P < 0.05). All predictive models showed commendable performance, with RF achieving the highest accuracy (0.921), followed by SVM (0.906), k-NN (0.889), LR (0.881), and AdaBoost (0.823). RF also excelled over the other models in terms of sensitivity and specificity, with a sensitivity of 0.912 and specificity of 0.892. The area under the curve values for RF, SVM, k-NN, LR, and AdaBoost were recorded at 0.903, 0.820, 0.804, 0.801, and 0.798, respectively. Conclusions: This research demonstrates that machine learning models can effectively predict the need for permanent CSF diversion in patients with ICH who underwent external ventricular drain placement for urgent CSF diversion, offering important prognostic insights that could facilitate early intervention and lead to potential cost reductions.
Machine learning for the prediction of in-hospital mortality in patients with spontaneous intracerebral hemorrhage in intensive care unit

Baojie Mao,Lichao Ling,Yuhang Pan,Rui Zhang,Wanning Zheng,Yanfei Shen,Wei Lu,Yuning Lu,Shanhu Xu,Jiong Wu,Ming Wang,Shu Wan

DOI: https://doi.org/10.1038/s41598-024-65128-8

IF: 4.6

2024-06-22

Scientific Reports

Abstract:This study aimed to develop a machine learning (ML)-based tool for early and accurate prediction of in-hospital mortality risk in patients with spontaneous intracerebral hemorrhage (sICH) in the intensive care unit (ICU). We did a retrospective study in our study and identified cases of sICH from the MIMIC IV (n = 1486) and Zhejiang Hospital databases (n = 110). The model was constructed using features selected through LASSO regression. Among five well-known models, the selection of the best model was based on the area under the curve (AUC) in the validation cohort. We further analyzed calibration and decision curves to assess prediction results and visualized the impact of each variable on the model through SHapley Additive exPlanations. To facilitate accessibility, we also created a visual online calculation page for the model. The XGBoost exhibited high accuracy in both internal validation (AUC = 0.907) and external validation (AUC = 0.787) sets. Calibration curve and decision curve analyses showed that the model had no significant bias as well as being useful for supporting clinical decisions. XGBoost is an effective algorithm for predicting in-hospital mortality in patients with sICH, indicating its potential significance in the development of early warning systems.

multidisciplinary sciences
Development and validation of comprehensive clinical outcome prediction models for acute ischaemic stroke in anterior circulation based on machine learning

Haiyan Zhang,Hongyi Chen,Chao Zhang,Aihong Cao,Zekuan Yu,Hao Wu,Jun Zhang,Daoying Geng

DOI: https://doi.org/10.1016/j.jocn.2022.07.022

IF: 2.116

2022-08-03

Journal of Clinical Neuroscience

Abstract:The current prediction models for the clinical outcome of acute ischaemic stroke (AIS) remain insufficient for individualized patient management strategies. We aimed to investigate machine learning (ML) performance in the clinical outcome prediction of AIS in anterior circulation and evaluate the clinical outcome by combining the quantitative evaluation indicators of perfusion features and basic clinical information. Four ML classifiers, support vector machine (SVM), naive Bayes (NB), logistic regression (LR), and random forest (RF) were trained on a cohort of 389 adult patients (training cohort [70 %]; external validation cohort [30 %]) from the Acute Stroke Center Registry of Huashan Hospital. Model performance was compared by a range of learning metrics. Most imaging parameters were strongly correlated with the outcome (range, 0.57 to 0.81), and the correlation between relative cerebral blood flow (rCBF) < 30 % and clinical outcome was the strongest (ρ = 0.81). As the reference parameters increased, the performance of the four models was greatly improved [SVM (AUC: from 0.79 to 0.99, F1-score: from 0.61 to 0.90), RF (AUC: from 0.88 to 0.98, F1-score: from 0.71 to 0.96), LR (AUC: from 0.80 to 0.97, F1-score: from 0.64 to 0.95), and NB (AUC: from 0.74 to 0.97, F1-score: from 0.66 to 0.92)]. The ensemble classifier model with all parameters had the highest F1-score (0.97). All the ML models, jointly considering the basic clinical information and quantitative evaluation indicators of computed tomography perfusion (CTP), showed good performance in the prediction of clinical outcome of AIS in anterior circulation.

neurosciences,clinical neurology
Model for predicting clinical outcome of the spontaneous intracerebral hemorrhage

HENG Wei-wei,ZHANG Xin,XU Yun

DOI: https://doi.org/10.3877/cma.j.issn.1674-0785.2013.06.017

2013-01-01

Abstract:Objective To guide the clinical physicians evaluating the prognosis of spontaneous intracerebral hemorrhage(ICH),we investigated the clinical characteristics of ICH and set up a model to predict the prognosis of ICH.Methods The clinical data of 265 patients were collected and studied retrospectively.All the patients were divided into two groups: good prognosis group (mRS score ≤2 points),and poor prognosis group (mRS score 3-6 points).The prognostic factors were analyzed with single factor and Logistic regression analyses.Results Age,blood glucose levels,secondary pneumonia,Glasgow coma scale,NIHSS score,activity of daily living scale,drinking scores, bleeding location,amount of hemorrhage,midline of brain shift were analyzed.However,the age,ADL,NIHSS score, and amount of hemorrhage were independent predictors of prognosis for cerebral hemorrhage at 30 days.The accuracy of the predictors was 83.3%,the negative predictive rate was 78.1% and positive predictive rate was 86.7%.Conclusions Age,ADL,NIHSS score,amount of hemorrhage may be used to predict the prognosis of cerebral hemorrhage after 30 days.
Construction of a machine learning-based prediction model for unfavorable discharge outcomes in patients with ischemic stroke

Yuancheng He,Xiaojuan Zhang,Yuexin Mei,Deng Qianyun,Xiuqing Zhang,Yuehua Chen,Jie Li,Zhou Meng,Yuehong Wei

DOI: https://doi.org/10.1016/j.heliyon.2024.e37179

IF: 3.776

2024-09-01

Heliyon

Abstract:Background: Ischemic stroke is a common and serious disease with economic and healthcare burdens. Predicting the unfavorable discharge outcome of patients is essential for formulating appropriate treatment strategies and providing personalized care. Therefore, this study aims to establish and validate a prediction model based on machine learning methods to accurately predict the discharge outcome of ischemic stroke patients, providing valuable information for clinical decision making. Methods: The derivation data consisted of 964 patients from Guangdong Provincial People's Hospital and was used for training and internal validation. A favourable discharge outcome was defined as a National Institutes of Health Stroke Scale score of ≤1 or a decrease of ≥8 points compared to the admission score. A predictive model was created based on 88 medical characteristics gathered during the patient's initial admission, using nine machine learning algorithms. The model's predictive performance was compared using various evaluation metrics. The final model's feature importance was ranked and explained using the Shapley additive explanation method. Findings: The random forest model demonstrated the greatest discriminative ability among the nine machine learning models. We created an interpretable random forest model by ranking and reducing the features based on their importance, which included eight features. In internal validations, the final model accurately predicted the discharge outcomes of ischemic stroke with AUC values of 0.903 and has been translated into a convenient tool to facilitate its utility in clinical settings. Conclusions: Our explainable ML model was not only successfully developed to accurately predict discharge outcomes in patients with ischemic stroke and it mitigated the concern of the "black-box" issue with an undirect interpretation of the ML technique.
Novel machine learning models to predict pneumonia events in supratentorial intracerebral hemorrhage populations: An analysis of the Risa-MIS-ICH study

Yan Zheng,Yuan-Xiang Lin,Qiu He,Ling-Yun Zhuo,Wei Huang,Zhu-Yu Gao,Ren-Long Chen,Ming-Pei Zhao,Ze-Feng Xie,Ke Ma,Wen-Hua Fang,Deng-Liang Wang,Jian-Cai Chen,De-Zhi Kang,Fu-Xin Lin

DOI: https://doi.org/10.3389/fneur.2022.955271

IF: 3.4

2022-08-26

Frontiers in Neurology

Abstract:Background: Stroke-associated pneumonia (SAP) contributes to high mortality rates in spontaneous intracerebral hemorrhage (sICH) populations. Accurate prediction and early intervention of SAP are associated with prognosis. None of the previously developed predictive scoring systems are widely accepted. We aimed to derive and validate novel supervised machine learning (ML) models to predict SAP events in supratentorial sICH populations. Methods: The data of eligible supratentorial sICH individuals were extracted from the Risa-MIS-ICH database and split into training, internal validation, and external validation datasets. The primary outcome was SAP during hospitalization. Univariate and multivariate analyses were used for variable filtering, and logistic regression (LR), Gaussian naïve Bayes (GNB), random forest (RF), K-nearest neighbor (KNN), support vector machine (SVM), extreme gradient boosting (XGB), and ensemble soft voting model (ESVM) were adopted for ML model derivations. The accuracy, sensitivity, specificity, and area under the curve (AUC) were adopted to evaluate the predictive value of each model with internal/cross-/external validations. Results: A total of 468 individuals with sICH were included in this work. Six independent variables [nasogastric feeding, airway support, unconscious onset, surgery for external ventricular drainage (EVD), larger sICH volume, and intensive care unit (ICU) stay] for SAP were identified and selected for ML prediction model derivations and validations. The internal and cross-validations revealed the superior and robust performance of the GNB model with the highest AUC value (0.861, 95% CI: 0.793–0.930), while the LR model had the highest AUC value (0.867, 95% CI: 0.812–0.923) in external validation. The ESVM method combining the other six methods had moderate but robust abilities in both cross-validation and external validation and achieved an AUC of 0.843 (95% CI: 0.784–0.902) in external validation. Conclusion: The ML models could effectively predict SAP in sICH populations, and our novel ensemble model demonstrated reliable robust performance outcomes despite the populational and algorithmic differences. This attempt indicated that ML application may benefit in the early identification of SAP.

neurosciences,clinical neurology
Development and Validation of a Clinical-Based Signature to Predict the 90-Day Functional Outcome for Spontaneous Intracerebral Hemorrhage

Xiaoyu Huang,Dan Wang,Qiaoying Zhang,Yaqiong Ma,Shenglin Li,Hui Zhao,Juan Deng,Jingjing Yang,JiaLiang Ren,Min Xu,Huaze Xi,Fukai Li,Hongyu Zhang,Yijing Xie,Long Yuan,Yucheng Hai,Mengying Yue,Qing Zhou,Junlin Zhou

DOI: https://doi.org/10.3389/fnagi.2022.904085

IF: 4.8

2022-01-01

Frontiers in Aging Neuroscience

Abstract:We aimed to develop and validate an objective and easy-to-use model for identifying patients with spontaneous intracerebral hemorrhage (ICH) who have a poor 90-day prognosis. This three-center retrospective study included a large cohort of 1,122 patients with ICH who presented within 6 h of symptom onset [training cohort, n = 835; internal validation cohort, n = 201; external validation cohort (center 2 and 3), n = 86]. We collected the patients' baseline clinical, radiological, and laboratory data as well as the 90-day functional outcomes. Independent risk factors for prognosis were identified through univariate analysis and multivariate logistic regression analysis. A nomogram was developed to visualize the model results while a calibration curve was used to verify whether the predictive performance was satisfactorily consistent with the ideal curve. Finally, we used decision curves to assess the clinical utility of the model. At 90 days, 714 (63.6%) patients had a poor prognosis. Factors associated with prognosis included age, midline shift, intraventricular hemorrhage (IVH), subarachnoid hemorrhage (SAH), hypodensities, ICH volume, perihematomal edema (PHE) volume, temperature, systolic blood pressure, Glasgow Coma Scale (GCS) score, white blood cell (WBC), neutrophil, and neutrophil-lymphocyte ratio (NLR) (p < 0.05). Moreover, age, ICH volume, and GCS were identified as independent risk factors for prognosis. For identifying patients with poor prognosis, the model showed an area under the receiver operating characteristic curve of 0.874, 0.822, and 0.868 in the training cohort, internal validation, and external validation cohorts, respectively. The calibration curve revealed that the nomogram showed satisfactory calibration in the training and validation cohorts. Decision curve analysis showed the clinical utility of the nomogram. Taken together, the nomogram developed in this study could facilitate the individualized outcome prediction in patients with ICH.
A comprehensive comparison of machine learning models for ICH prognostication: Retrospective review of 1501 intra-cerebral hemorrhage patients from the Qatar stroke database

Aizaz Ali,Umar T. Ayub,Khaled Gharaibeh,Rahul Rao,Naveed Akhtar,Mouhammad Jumaa,Ashfaq Shuaib

DOI: https://doi.org/10.1007/s10143-024-02877-0

IF: 2.8

2024-09-26

Neurosurgical Review

Abstract:Multiple prognostic scores have been developed to predict morbidity and mortality in patients with spontaneous intracerebral hemorrhage(sICH). Since the advent of machine learning(ML), different ML models have also been developed for sICH prognostication. There is however a need to verify the validity of these ML models in diverse patient populations. We aim to create machine learning models for prognostication purposes in the Qatari population. By incorporating inpatient variables into model development, we aim to leverage more information. 1501 consecutive patients with acute sICH admitted to Hamad General Hospital(HGH) between 2013 and 2023 were included. We trained, evaluated, and compared several ML models to predict 90-day mortality and functional outcomes. For our dataset, we randomly selected 80% patients for model training and 20% for validation and used k-fold cross validation to train our models. The ML workflow included imbalanced class correction and dimensionality reduction in order to evaluate the effect of each. Evaluation metrics such as sensitivity, specificity, F-1 score were calculated for each prognostic model. Mean age was 50.8(SD 13.1) years and 1257(83.7%) were male. Median ICH volume was 7.5 ml(IQR 12.6). 222(14.8%) died while 897(59.7%) achieved good functional outcome at 90 days. For 90-day mortality, random forest(RF) achieved highest AUC(0.906) whereas for 90-day functional outcomes, logistic regression(LR) achieved highest AUC(0.888). Ensembling provided similar results to the best performing models, namely RF and LR, obtaining an AUC of 0.904 for mortality and 0.883 for functional outcomes. Random Forest achieved the highest AUC for 90-day mortality, and LR achieved the highest AUC for 90-day functional outcomes. Comparing ML models, there is minimal difference between their performance. By creating an ensemble of our best performing individual models we maintained maximum accuracy and decreased variance of functional outcome and mortality prediction when compared with individual models.

surgery,clinical neurology
Explainable machine learning for predicting neurological outcome in hemorrhagic and ischemic stroke patients in critical care

Huawei Wei,Xingshuai Huang,Yixuan Zhang,Guowei Jiang,Ruifeng Ding,Mengqiu Deng,Liangtian Wei,Hongbin Yuan

DOI: https://doi.org/10.3389/fneur.2024.1385013

IF: 3.4

2024-06-11

Frontiers in Neurology

Abstract:Aim: The objective of this study is to develop accurate machine learning (ML) models for predicting the neurological status at hospital discharge of critically ill patients with hemorrhagic and ischemic stroke and identify the risk factors associated with the neurological outcome of stroke, thereby providing healthcare professionals with enhanced clinical decision-making guidance. Materials and methods: Data of stroke patients were extracted from the eICU Collaborative Research Database (eICU-CRD) for training and testing sets and the Medical Information Mart for Intensive Care IV (MIMIC IV) database for external validation. Four machine learning models, namely gradient boosting classifier (GBC), logistic regression (LR), multi-layer perceptron (MLP), and random forest (RF), were used for prediction of neurological outcome. Furthermore, shapley additive explanations (SHAP) algorithm was applied to explain models visually. Results: A total of 1,216 hemorrhagic stroke patients and 954 ischemic stroke patients from eICU-CRD and 921 hemorrhagic stroke patients 902 ischemic stroke patients from MIMIC IV were included in this study. In the hemorrhagic stroke cohort, the LR model achieved the highest area under curve (AUC) of 0.887 in the test cohort, while in the ischemic stroke cohort, the RF model demonstrated the best performance with an AUC of 0.867 in the test cohort. Further analysis of risk factors was conducted using SHAP analysis and the results of this study were converted into an online prediction tool. Conclusion: ML models are reliable tools for predicting hemorrhagic and ischemic stroke neurological outcome and have the potential to improve critical care of stroke patients. The summarized risk factors obtained from SHAP enable a more nuanced understanding of the reasoning behind prediction outcomes and the optimization of the treatment strategy.

neurosciences,clinical neurology
The use of cloud based machine learning to predict outcome in intracerebral haemorrhage without explicit programming expertise

Ajay Hegde,Deepu Vijaysenan,Pitchaiah Mandava,Girish Menon

DOI: https://doi.org/10.1007/s10143-024-03115-3

IF: 2.8

2024-12-05

Neurosurgical Review

Abstract:Machine Learning (ML) techniques require novel computer programming skills along with clinical domain knowledge to produce a useful model. We demonstrate the use of a cloud-based ML tool that does not require any programming expertise to develop, validate and deploy a prognostic model for Intracerebral Haemorrhage (ICH). The data of patients admitted with Spontaneous Intracerebral haemorrhage from January 2015 to December 2019 was accessed from our prospectively maintained hospital stroke registry. 80% of the dataset was used for training, 10% for validation, and 10% for testing. Seventeen input variables were used to predict the dichotomized outcomes (Good outcome mRS 0–3/ Bad outcome mRS 4–6), using machine learning (ML) and logistic regression (LR) models. The two different approaches were evaluated using Area Under the Curve (AUC) for Receiver Operating Characteristic (ROC), Precision recall and accuracy. Our data set comprised of a cohort of 1000 patients. The data was split 8:1 for training & testing respectively. The AUC ROC of the ML model was 0.86 with an accuracy of 75.7%. With LR AUC ROC was 0.74 with an accuracy of 73.8%. Feature importance chart showed that Glasgow coma score (GCS) at presentation had the highest relative importance, followed by hematoma volume and age in both approaches. Machine learning models perform better when compared to logistic regression. Models can be developed by clinicians possessing domain expertise and no programming experience using cloud based tools. The models so developed lend themselves to be incorporated into clinical workflow.

surgery,clinical neurology
Mortality Prediction in Cerebral Hemorrhage Patients Using Machine Learning Algorithms in Intensive Care Units

Ximing Nie,Yuan Cai,Jingyi Liu,Xiran Liu,Jiahui Zhao,Zhonghua Yang,Miao Wen,Liping Liu

DOI: https://doi.org/10.3389/fneur.2020.610531

IF: 3.4

2021-01-20

Frontiers in Neurology

Abstract:Objectives: This study aims to investigate whether the machine learning algorithms could provide an optimal early mortality prediction method compared with other scoring systems for patients with cerebral hemorrhage in intensive care units in clinical practice. Methods: Between 2008 and 2012, from Intensive Care III (MIMIC-III) database, all cerebral hemorrhage patients monitored with the MetaVision system and admitted to intensive care units were enrolled in this study. The calibration, discrimination, and risk classification of predicted hospital mortality based on machine learning algorithms were assessed. The primary outcome was hospital mortality. Model performance was assessed with accuracy and receiver operating characteristic curve analysis. Results: Of 760 cerebral hemorrhage patients enrolled from MIMIC database [mean age, 68.2 years (SD, ±15.5)], 383 (50.4%) patients died in hospital, and 377 (49.6%) patients survived. The area under the receiver operating characteristic curve (AUC) of six machine learning algorithms was 0.600 (nearest neighbors), 0.617 (decision tree), 0.655 (neural net), 0.671(AdaBoost), 0.819 (random forest), and 0.725 (gcForest). The AUC was 0.423 for Acute Physiology and Chronic Health Evaluation II score. The random forest had the highest specificity and accuracy, as well as the greatest AUC, showing the best ability to predict in-hospital mortality. Conclusions: Compared with conventional scoring system and the other five machine learning algorithms in this study, random forest algorithm had better performance in predicting in-hospital mortality for cerebral hemorrhage patients in intensive care units, and thus further research should be conducted on random forest algorithm.

neurosciences,clinical neurology
A Prediction Model for Neurological Deterioration in Patients with Acute Spontaneous Intracerebral Hemorrhage

Daiquan Gao,Xiaojuan Zhang,Yunzhou Zhang,Rujiang Zhang,Yuanyuan Qiao

DOI: https://doi.org/10.3389/fsurg.2022.886856

IF: 1.8

2022-05-27

Frontiers in Surgery

Abstract:Aim The aim of this study was to explore factors related to neurological deterioration (ND) after spontaneous intracerebral hemorrhage (sICH) and establish a prediction model based on random forest analysis in evaluating the risk of ND. Methods The clinical data of 411 patients with acute sICH at the Affiliated Hospital of Jining Medical University and Xuanwu Hospital of Capital Medical University between January 2018 and December 2020 were collected. After adjusting for variables, multivariate logistic regression was performed to investigate the factors related to the ND in patients with acute ICH. Then, based on the related factors in the multivariate logistic regression and four variables that have been identified as contributing to ND in the literature, we established a random forest model. The receiver operating characteristic curve was used to evaluate the prediction performance of this model. Results The result of multivariate logistic regression analysis indicated that time of onset to the emergency department (ED), baseline hematoma volume, serum sodium, and serum calcium were independently associated with the risk of ND. Simultaneously, the random forest model was developed and included eight predictors: serum calcium, time of onset to ED, serum sodium, baseline hematoma volume, systolic blood pressure change in 24 h, age, intraventricular hemorrhage expansion, and gender. The area under the curve value of the prediction model reached 0.795 in the training set and 0.713 in the testing set, which suggested the good predicting performance of the model. Conclusion Some factors related to the risk of ND were explored. Additionally, a prediction model for ND of acute sICH patients was developed based on random forest analysis, and the developed model may have a good predictive value through the internal validation.

surgery
Machine learning prediction of hematoma expansion in acute intracerebral hemorrhage

Satoru Tanioka,Tetsushi Yago,Katsuhiro Tanaka,Fujimaro Ishida,Tomoyuki Kishimoto,Kazuhiko Tsuda,Munenari Ikezawa,Tomohiro Araki,Yoichi Miura,Hidenori Suzuki

DOI: https://doi.org/10.1038/s41598-022-15400-6

IF: 4.6

2022-07-23

Scientific Reports

Abstract:To examine whether machine learning (ML) approach can be used to predict hematoma expansion in acute intracerebral hemorrhage (ICH) with accuracy and widespread applicability, we applied ML algorithms to multicenter clinical data and CT findings on admission. Patients with acute ICH from three hospitals (n = 351) and those from another hospital (n = 71) were retrospectively assigned to the development and validation cohorts, respectively. To develop ML predictive models, the k-nearest neighbors (k-NN) algorithm, logistic regression, support vector machines (SVMs), random forests, and XGBoost were applied to the patient data in the development cohort. The models were evaluated for their performance on the patient data in the validation cohort, which was compared with previous scoring methods, the BAT, BRAIN, and 9-point scores. The k-NN algorithm achieved the highest area under the receiver operating characteristic curve (AUC) of 0.790 among all ML models, and the sensitivity, specificity, and accuracy were 0.846, 0.733, and 0.775, respectively. The BRAIN score achieved the highest AUC of 0.676 among all previous scoring methods, which was lower than the k-NN algorithm (p = 0.016). We developed and validated ML predictive models of hematoma expansion in acute ICH. The models demonstrated good predictive ability, showing better performance than the previous scoring methods.

multidisciplinary sciences
Development and validation of outcome prediction model for reperfusion therapy in acute ischemic stroke using nomogram and machine learning

Qianwen Wang,Jiawen Yin,Lei Xu,Jun Lu,Juan Chen,Yuhui Chen,Alimu Wufuer,Tao Gong

DOI: https://doi.org/10.1007/s10072-024-07329-7

2024-01-26

Neurological Sciences

Abstract:ObjectiveTo develop logistic regression nomogram and machine learning (ML)-based models to predict 3-month unfavorable functional outcome for acute ischemic stroke (AIS) patients undergoing reperfusion therapy.MethodsPatients undergoing reperfusion therapy (intravenous thrombolysis and/or endovascular treatment) were prospectively recruited. Unfavorable outcome was defined as 3-month modified Rankin Scale (mRS) score 3–6. The independent risk factors associated with unfavorable outcome were obtained by regression analysis and included in the prediction model. The performance of nomogram was assessed by the area under the curve (AUC), calibration curve, and decision curve analysis (DCA). ML models were compared with nomogram using AUC; the generalizability of all models was ascertained in an external cohort.ResultsA total of 505 patients were enrolled, with 256 in the model construction, and 249 in the external validation. Five variables were identified as prognostic factors: baseline NIHSS, D-dimer level, random blood glucose (RBG), blood urea nitrogen (BUN), and systolic blood pressure (SBP) before reperfusion. The AUC values of nomogram were 0.865, 0.818, and 0.779 in the training set, test set, and external validation, respectively. The calibration curve and DCA indicated appreciable reliability and good net benefits. The best three ML models were extra trees (ET), CatBoost, and random forest (RF) models; all of them showed favorable discrimination in the training cohort, and confirmed in the test and external sets.ConclusionBaseline NIHSS, D-dimer, RBG, BUN, and SBP before reperfusion were independent predictors for 3-month unfavorable outcome after reperfusion therapy in AIS patients. Both nomogram and ML models showed good discrimination and generalizability.

neurosciences,clinical neurology

Development and validation of a random forest model to predict functional outcome in patients with intracerebral hemorrhage

Machine Learning-Based Approaches for Prediction of Patients’ Functional Outcome and Mortality after Spontaneous Intracerebral Hemorrhage

Predicting Intraventricular Hemorrhage Growth with a Machine Learning-Based, Radiomics-Clinical Model

Predicting the recurrence of spontaneous intracerebral hemorrhage using a machine learning model

Causative Classification of Ischemic Stroke by the Machine Learning Algorithm Random Forests

Prediction of large vessel occlusion for ischaemic stroke by using the machine learning model random forests

Predicting the Outcome of Patients with Aneurysmal Subarachnoid Hemorrhage: A Machine-Learning-Guided Scorecard

The Value of Machine Learning Models in Predicting Factors Associated with the Need for Permanent Shunting in Patients with Intracerebral Hemorrhage Requiring Emergency Cerebrospinal Fluid Diversion

Machine learning for the prediction of in-hospital mortality in patients with spontaneous intracerebral hemorrhage in intensive care unit

Development and validation of comprehensive clinical outcome prediction models for acute ischaemic stroke in anterior circulation based on machine learning

Model for predicting clinical outcome of the spontaneous intracerebral hemorrhage

Construction of a machine learning-based prediction model for unfavorable discharge outcomes in patients with ischemic stroke

Novel machine learning models to predict pneumonia events in supratentorial intracerebral hemorrhage populations: An analysis of the Risa-MIS-ICH study

Development and Validation of a Clinical-Based Signature to Predict the 90-Day Functional Outcome for Spontaneous Intracerebral Hemorrhage

A comprehensive comparison of machine learning models for ICH prognostication: Retrospective review of 1501 intra-cerebral hemorrhage patients from the Qatar stroke database

Explainable machine learning for predicting neurological outcome in hemorrhagic and ischemic stroke patients in critical care

The use of cloud based machine learning to predict outcome in intracerebral haemorrhage without explicit programming expertise

Mortality Prediction in Cerebral Hemorrhage Patients Using Machine Learning Algorithms in Intensive Care Units

A Prediction Model for Neurological Deterioration in Patients with Acute Spontaneous Intracerebral Hemorrhage

Machine learning prediction of hematoma expansion in acute intracerebral hemorrhage

Development and validation of outcome prediction model for reperfusion therapy in acute ischemic stroke using nomogram and machine learning