Development and Validation of Machine Learning Models for Prediction of Seizure Outcome After Pediatric Epilepsy Surgery
Omar Yossofzai,Aria Fallah,Cassia Maniquis,Shelly Wang,John Ragheb,Alexander G. Weil,Tristan Brunette‐Clement,Andrea Andrade,Nicholas Mitsakakis,Elysa Widjaja,George Ibrahim
DOI: https://doi.org/10.1111/epi.17320
IF: 6.74
2022-06-08
Epilepsia
Abstract:Objective There is substantial variability in reported seizure outcome following pediatric epilepsy surgery, and lack of individualized predictive tools that could evaluate the probability of seizure freedom post‐surgery. The aim of this study was to develop and validate a supervised machine learning (ML) model for predicting seizure freedom after pediatric epilepsy surgery. Methods This is a multi‐center retrospective study of children who underwent epilepsy surgery in five pediatric epilepsy centers in North America. Clinical information, diagnostic investigations, and surgical characteristics were collected, and used as features to predict seizure‐free outcome one‐year after surgery. The dataset was split randomly into 80% training and 20% testing data. Thirty‐five combinations of five feature sets with seven ML classifiers were assessed on the training cohort using 10‐fold cross‐validation for model development. The performance of the optimal combination of ML classifier and feature set was evaluated in the testing cohort, and compared with logistic regression, a classical statistical approach. Results Of the 801 patients included, 61.3% were seizure‐free one‐year post surgery. During model development, the best combination was XGBoost ML algorithm with five features from the univariate feature set, including number of anti‐seizure medications, MRI lesion, age at seizure onset, video‐EEG concordance, and surgery type, with a mean area under the curve (AUC) of 0.73 (95%CI:0.69–0.77). The combination of XGBoost and univariate feature set was then evaluated on the testing cohort and achieved an AUC of 0.74 [95%CI:0.66–0.82] (sensitivity=0.87 [95%CI:0.81–0.94], specificity=0.58 [95%CI:0.47–0.71]). The XGBoost model outperformed the logistic regression model (AUC=0.72 [95%CI:0.63‐0.80], sensitivity=0.72 [95%CI:0.63–0.82], specificity=0.66 [95%CI:0.53–0.77]) in the testing cohort (p=0.005). Significance This study identified important features and validated a ML algorithm, XGBoost, for predicting the probability of seizure freedom after pediatric epilepsy surgery. Improved prognostication of epilepsy surgery is critical for pre‐surgical counselling and will inform treatment decisions.
clinical neurology