Abstract:Machine learning (ML) has revolutionized data processing in recent years. This study presents the results of the first prediction models based on a long-term monocentric data registry of patients with microsurgically treated unruptured intracranial aneurysms (UIAs) using a temporal train-test split. Temporal train-test splits allow to simulate prospective validation, and therefore provide more accurate estimations of a model's predictive quality when applied to future patients. ML models for the prediction of the Glasgow outcome scale, modified Rankin Scale (mRS), and new transient or permanent neurological deficits (output variables) were created from all UIA patients that underwent microsurgery at the Kepler University Hospital Linz (Austria) between 2002 and 2020 (n = 466), based on 18 patient- and 10 aneurysm-specific preoperative parameters (input variables). Train-test splitting was performed with a temporal split for outcome prediction in microsurgical therapy of UIA. Moreover, an external validation was conducted on an independent external data set (n = 256) of the Department of Neurosurgery, University Medical Centre Hamburg-Eppendorf. In total, 722 aneurysms were included in this study. A postoperative mRS > 2 was best predicted by a quadratic discriminant analysis (QDA) estimator in the internal test set, with an area under the receiver operating characteristic curve (ROC-AUC) of 0.87 ± 0.03 and a sensitivity and specificity of 0.83 ± 0.08 and 0.71 ± 0.07, respectively. A Multilayer Perceptron predicted the post- to preoperative mRS difference > 1 with a ROC-AUC of 0.70 ± 0.02 and a sensitivity and specificity of 0.74 ± 0.07 and 0.50 ± 0.04, respectively. The QDA was the best model for predicting a permanent new neurological deficit with a ROC-AUC of 0.71 ± 0.04 and a sensitivity and specificity of 0.65 ± 0.24 and 0.60 ± 0.12, respectively. Furthermore, these models performed significantly better than the classic logistic regression models (p < 0.0001). The present results showed good performance in predicting functional and clinical outcomes after microsurgical therapy of UIAs in the internal data set, especially for the main outcome parameters, mRS and permanent neurological deficit. The external validation showed poor discrimination with ROC-AUC values of 0.61, 0.53 and 0.58 respectively for predicting a postoperative mRS > 2, a pre- and postoperative difference in mRS > 1 point and a GOS < 5. Therefore, generalizability of the models could not be demonstrated in the external validation. A SHapley Additive exPlanations (SHAP) analysis revealed that this is due to the most important features being distributed quite differently in the internal and external data sets. The implementation of newly available data and the merging of larger databases to form more broad-based predictive models is imperative in the future.

External Validation of the Modified Southwestern Aneurysm Severity Index in the Barrow Ruptured Aneurysm Trial Surgical Cohort

Scoring Model To Predict Functional Outcome In Poor-Grade Aneurysmal Subarachnoid Hemorrhage

A Scoring Model to Predict the Prognosis of Patients with Poor-Grade Aneurysmal Subarachnoid Hemorrhage

Validity of the modified Rankin Scale in patients with aneurysmal subarachnoid hemorrhage: a randomized study

External validation of a 5-year survival prediction model after elective abdominal aortic aneurysm repair

A Prognostic Model for Early Post-Treatment Outcome of Elderly Patients with Aneurysmal Subarachnoid Hemorrhage

Review of Scoring Systems for Predicting 30-Day Mortality in Ruptured Abdominal Aortic Aneurysm

Machine learning based outcome prediction of microsurgically treated unruptured intracranial aneurysms

External Validation of the Spinal Orthopedic Research Group Index for Spinal Epidural Abscess 90-day Mortality in a Geographically Remote Population

Predicting 30-day Mortality after Ruptured Abdominal Aortic Aneurysms: Validation of the Harborview Risk Score in a Single-Center Dutch Study Population

Validation and Comparison of Aneurysmal Subarachnoid Hemorrhage Grading Scales in Angiogram-Negative Subarachnoid Hemorrhage Patients

External Validation of the Adult Spinal Deformity (ASD) Frailty Index (ASD-FI) in the Scoli-RISK-1 Patient Database

Comparing radiographic scores for prediction of complications and outcome of aneurysmal subarachnoid hemorrhage: which performs best?

Validation of the MIDA mortality risk score in a surgical cohort of patients with primary mitral regurgitation

Outcome after Interdisciplinary Treatment for Aneurysmal Subarachnoid Hemorrhage-A Single Center Experience

The simplified acute physiology score to predict outcome in patients with subarachnoid hemorrhage

External validation of the SYNTAX score II 2020 in patients with chronic renal insufficiency

External validation of the SI2NCAL2C score for outcomes following cerebral venous thrombosis

Innovative prognostication: a novel nomogram for post-interventional aneurysmal subarachnoid hemorrhage patients

Development of a machine learning algorithm for predicting in-hospital and 1-year mortality after traumatic spinal cord injury

Validation of the accuracy of the modified World Federation of Neurosurgical Societies subarachnoid hemorrhage grading scale for predicting the outcomes of patients with aneurysmal subarachnoid hemorrhage