Abstract:6575 Background: In patients with advanced cancer who need unplanned surgery, shared decision making is complex. Surgical risk assessment with high accuracy and in real time may help improve prediction of postoperative outcomes. We previously trained and tested an explainable machine learning model (MLM) to estimate postoperative Clavien-Dindo grade 3 or higher (CD 3+) complication risk in cancer inpatients undergoing unplanned surgery. In this prospective validation study, we report the performance of the MLM Surgical Risk Score (SRS) in the prediction of postoperative outcomes as well as determine association of the risk score with hospital length of stay and mortality. Methods: A MLM SRS for cancer inpatients requiring an unplanned, same-hospitalization major surgery was generated using real-time patient specific EHR data. The SRS was integrated into surgeon preoperative workflow. Postoperative outcomes including complications, length of hospital stay, and 30-day mortality were reported. The SRS was dichotomized as high or low based on prior validation threshold for postoperative CD3+ complication development. Model performance was assessed with area under receiver operating characteristic (AUROC) and area under precision-recall curves (AUPRC). Differences in outcomes between high and low-risk SRS groups were studied using Mann-Whitney U test and Fisher's exact test. Results: During the study period, 135 cancer inpatients were assessed by surgeons for 166 major unplanned operations. Of the 166 operations, 126 were completed and 40 were cancelled. The SRS was high in 81 (49%) and low in 85 (51%). The most common cancer diagnosis was colorectal (n=39, 28.8%). Operations performed with the highest frequencies were for enteral access (e.g.gastrostomy) followed by exploratory laparotomy and enterectomy. CD 3+ complications were identified in 31% of the completed operations (n=39/126) and included death (n = 10); abscess (n=4); postoperative hemorrhage (n=3); and anastomotic leak (n=2). The SRS predicted CD 3+ complications with a precision of47% and recall of 73%, resulting in an AUROC of 0.75 and AUPRC of 0.58. When comparing patients with high-risk to low-risk SRS, median overall LOS was 10 vs 7 days (p=0.013), median LOS after operation was 9 vs 6 days (p=0.003), 30-day mortality was 19.0% vs 5.3% (p=0.015), and 30-day postoperative mortality was 13.2% vs 3.3% (p=0.04). Conclusions: In this prospective study, preoperative SRS generated from a trained MLM on real-time EHR data demonstrated an excellent ability to predict individual risk of postoperative complications. In addition, patients with high SRS have longer postoperative LOS and increased mortality. By improving discrimination of risk of postoperative complications and informing on treatment outcomes, integration of the MLM SRS into the consenting process may enable better informed decision making in cancer inpatients.

Length of Stay Prediction Models for Oral Cancer Surgery: Machine Learning, Statistical and ACS‐NSQIP

Performance of artificial intelligence-based algorithms to predict prolonged length of stay after head and neck cancer surgery

Prediction of Length of Stay After Colorectal Surgery Using Intraoperative Risk Factors

Data analytics and artificial intelligence in predicting length of stay, readmission, and mortality: a population-based study of surgical management of colorectal cancer

Integrating Machine Learning with Web-Based Tools for Personalized Prognosis in Oral Adenoid Cystic Carcinoma

Adopting combination machine learning models could reduce hospital length of stay for oncology patients.

Pre- and intra-operative predictors of postoperative hospital length of stay in patients undergoing radical prostatectomy for prostate cancer in China: a retrospective observational study

Development and validation of a novel nomogram model for identifying risk of prolonged length of stay among patients receiving free vascularized flap reconstruction of head and neck cancer

Machine learning to predict early recurrence after oesophageal cancer surgery

Machine learning methods applied to audit of surgical outcomes after treatment for cancer of the head and neck

Development and Validation of Machine Learning Models for Predicting Tumor Progression in OSCC

Machine learning and postoperative complications: Determining risk before surgery in patients with cancer.

Development of a Machine Learning Model for Survival Risk Stratification of Patients With Advanced Oral Cancer

Prognosing post-treatment outcomes of head and neck cancer using structured data and machine learning: A systematic review

The application of machine learning algorithms in predicting the length of stay following femoral neck fracture

Risk factors for postoperative recovery in oral cancer surgery: A retrospective cohort study

Predicting High-Value Care Outcomes After Surgery for Non-Skull Base Meningiomas

A Machine Learning-Based Online Prediction Tool for Predicting Short-Term Postoperative Outcomes Following Spinal Tumor Resections

Enhancing Preoperative Outcome Prediction: A Comparative Retrospective Case–Control Study on Machine Learning versus the International Esodata Study Group Risk Model for Predicting 90-Day Mortality in Oncologic Esophagectomy

Prediction Model of Anastomotic Leakage Among Esophageal Cancer Patients After Receiving an Esophagectomy: Machine Learning Approach

Construction of a Mortality Risk Prediction Model for Elderly People at Risk of Lobectomy for NSCLC