Abstract:Objective: Prediction of outcomes following carotid endarterectomy (CEA) remains challenging, with a lack of standardized tools to guide perioperative management. We used machine learning (ML) to develop automated algorithms that predict outcomes following CEA. Methods: The Vascular Quality Initiative (VQI) database was used to identify patients who underwent CEA between 2003 and 2022. We identified 71 potential predictor variables (features) from the index hospitalization (43 preoperative [demographic/clinical], 21 intraoperative [procedural], and 7 postoperative [in-hospital complications]). The primary outcome was stroke or death at 1 year following CEA. Our data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, we trained six ML models using preoperative features (Extreme Gradient Boosting [XGBoost], random forest, Naïve Bayes classifier, support vector machine, artificial neural network, and logistic regression). The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). After selecting the best performing algorithm, additional models were built using intra- and postoperative data. Model robustness was evaluated using calibration plots and Brier scores. Performance was assessed on subgroups based on age, sex, race, ethnicity, insurance status, symptom status, and urgency of surgery. Results: Overall, 166,369 patients underwent CEA during the study period. In total, 7749 patients (4.7%) had the primary outcome of stroke or death at 1 year. Patients with an outcome were older with more comorbidities, had poorer functional status, and demonstrated higher risk anatomic features. They were also more likely to undergo intraoperative surgical re-exploration and have in-hospital complications. Our best performing prediction model at the preoperative stage was XGBoost, achieving an AUROC of 0.90 (95% confidence interval [CI], 0.89-0.91). In comparison, logistic regression had an AUROC of 0.65 (95% CI, 0.63-0.67), and existing tools in the literature demonstrate AUROCs ranging from 0.58 to 0.74. Our XGBoost models maintained excellent performance at the intra- and postoperative stages, with AUROCs of 0.90 (95% CI, 0.89-0.91) and 0.94 (95% CI, 0.93-0.95), respectively. Calibration plots showed good agreement between predicted and observed event probabilities with Brier scores of 0.15 (preoperative), 0.14 (intraoperative), and 0.11 (postoperative). Of the top 10 predictors, eight were preoperative features, including comorbidities, functional status, and previous procedures. Model performance remained robust on all subgroup analyses. Conclusions: We developed ML models that accurately predict outcomes following CEA. Our algorithms perform better than logistic regression and existing tools, and therefore, have potential for important utility in guiding perioperative risk mitigation strategies to prevent adverse outcomes.

The use of machine learning for predicating complications of free flap head and neck reconstruction.

Predicting reoperation and readmission for head and neck free flap patients using machine learning

Development and Evaluation of a Machine Learning Prediction Model for Flap Failure in Microvascular Breast Reconstruction

Machine Learning Demonstrates High Accuracy for Disease Diagnosis and Prognosis in Plastic Surgery

Development and Assessment of Machine Learning Models for Individualized Risk Assessment of Mastectomy Skin Flap Necrosis

Machine learning models on a web application to predict short-term postoperative outcomes following anterior cervical discectomy and fusion

Predicting Colonic Neoplasia Surgical Complications: A Machine Learning Approach

Predictive Factors for Delayed Recovery From Anesthesia in Patients Receiving Free Vascularized Flap Reconstruction for Head and Neck Defects: A Retrospective Cohort Study

Risk predictions of surgical wound complications based on a machine learning algorithm: A systematic review

Prediction of postoperative complications in patients undergoing head and neck surgery with free-flap reconstruction

Machine learning and postoperative complications: Determining risk before surgery in patients with cancer.

Predicting Surgical Complications in Patients Undergoing Elective Adult Spinal Deformity Procedures Using Machine Learning

Machine learning methods applied to audit of surgical outcomes after treatment for cancer of the head and neck

Development of a Machine Learning Algorithm to Forecast the Likelihood of Postoperative Neurological Complications in Patients With Parotid Tumors

A supervised machine learning model for identifying predictive factors for recommending head and neck cancer surgery

Using machine learning to predict outcomes following carotid endarterectomy

Development of a machine learning algorithm to predict complications of total laparoscopic anterior resection and natural orifice specimen extraction surgery in rectal cancer

A Machine Learning-Based Online Prediction Tool for Predicting Short-Term Postoperative Outcomes Following Spinal Tumor Resections

Machine learning for prediction of postoperative complications after hepato-biliary and pancreatic surgery

When a Good Flap Turns Bad: A Temporal Predictive Model for Free Flap Complications

Risk prediction of complicated course in patients undergoing major head and neck surgery with free flap reconstruction