Predicting outcomes following lower extremity open revascularization using machine learning

Ben Li,Raj Verma,Derek Beaton,Hani Tamim,Mohamad A. Hussain,Jamal J. Hoballah,Douglas S. Lee,Duminda N. Wijeysundera,Charles de Mestral,Muhammad Mamdani,Mohammed Al-Omran
DOI: https://doi.org/10.1038/s41598-024-52944-1
IF: 4.6
2024-02-06
Scientific Reports
Abstract:Lower extremity open revascularization is a treatment option for peripheral artery disease that carries significant peri-operative risks; however, outcome prediction tools remain limited. Using machine learning (ML), we developed automated algorithms that predict 30-day outcomes following lower extremity open revascularization. The National Surgical Quality Improvement Program targeted vascular database was used to identify patients who underwent lower extremity open revascularization for chronic atherosclerotic disease between 2011 and 2021. Input features included 37 pre-operative demographic/clinical variables. The primary outcome was 30-day major adverse limb event (MALE; composite of untreated loss of patency, major reintervention, or major amputation) or death. Our data were split into training (70%) and test (30%) sets. Using tenfold cross-validation, we trained 6 ML models. Overall, 24,309 patients were included. The primary outcome of 30-day MALE or death occurred in 2349 (9.3%) patients. Our best performing prediction model was XGBoost, achieving an area under the receiver operating characteristic curve (95% CI) of 0.93 (0.92–0.94). The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.08. Our ML algorithm has potential for important utility in guiding risk mitigation strategies for patients being considered for lower extremity open revascularization to improve outcomes.
multidisciplinary sciences
What problem does this paper attempt to address?
This paper aims to solve the problem of predicting major adverse limb events (MALE) or death within 30 days after lower - extremity open vascular reconstruction. Specifically, the authors developed automated algorithms using machine - learning techniques to predict the 30 - day prognosis after lower - extremity open vascular reconstruction. The research background is that although lower - extremity open vascular reconstruction is an option for treating peripheral artery disease, it has a high peri - operative risk and currently lacks effective prognostic prediction tools. Through this study, the authors hope to provide a practical tool to help doctors assess patients' surgical risks and thus improve patient prognosis. ### Research Methods and Results 1. **Data Sources**: - The study used data from the American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) Targeted Vascular Database, covering patients who underwent lower - extremity open vascular reconstruction between 2011 and 2021. 2. **Input Features**: - It includes 37 preoperative demographic and clinical variables, such as age, gender, body mass index, race, ethnicity, comorbidities (hypertension, diabetes, smoking status, etc.), laboratory test results (sodium, blood urea nitrogen, creatinine, etc.), limb hemodynamic indicators (ankle - brachial index, toe pressure, etc.), and surgery - related features (surgery urgency, ASA classification, etc.). 3. **Primary Outcome**: - Major adverse limb events (MALE) within 30 days, defined as untreated loss of patency, major re - intervention or major amputation, or death. 4. **Model Development**: - Six machine - learning models were used for training and testing, including XGBoost, Random Forest, Naive Bayes Classifier, Radial Basis Function Support Vector Machine (SVM), Multilayer Perceptron (MLP) Artificial Neural Network, and Logistic Regression. - The best - performing model was XGBoost, with an area under the receiver operating characteristic curve (AUROC) reaching 0.93 (95% CI: 0.92 - 0.94). 5. **Calibration and Validation**: - The calibration plot showed good agreement between the predicted probability and the actual event probability, with a Brier score of 0.08. - The robustness of the model was further verified through the analysis of different subgroups (such as age, gender, race, symptom status, etc.). ### Conclusion This study successfully developed a machine - learning - based prediction model that can effectively predict major adverse limb events or death within 30 days after lower - extremity open vascular reconstruction. This tool has important clinical application value and can help doctors better assess patients' surgical risks, thereby formulating more reasonable risk - management strategies and improving patient prognosis.