Abstract:6575 Background: In patients with advanced cancer who need unplanned surgery, shared decision making is complex. Surgical risk assessment with high accuracy and in real time may help improve prediction of postoperative outcomes. We previously trained and tested an explainable machine learning model (MLM) to estimate postoperative Clavien-Dindo grade 3 or higher (CD 3+) complication risk in cancer inpatients undergoing unplanned surgery. In this prospective validation study, we report the performance of the MLM Surgical Risk Score (SRS) in the prediction of postoperative outcomes as well as determine association of the risk score with hospital length of stay and mortality. Methods: A MLM SRS for cancer inpatients requiring an unplanned, same-hospitalization major surgery was generated using real-time patient specific EHR data. The SRS was integrated into surgeon preoperative workflow. Postoperative outcomes including complications, length of hospital stay, and 30-day mortality were reported. The SRS was dichotomized as high or low based on prior validation threshold for postoperative CD3+ complication development. Model performance was assessed with area under receiver operating characteristic (AUROC) and area under precision-recall curves (AUPRC). Differences in outcomes between high and low-risk SRS groups were studied using Mann-Whitney U test and Fisher's exact test. Results: During the study period, 135 cancer inpatients were assessed by surgeons for 166 major unplanned operations. Of the 166 operations, 126 were completed and 40 were cancelled. The SRS was high in 81 (49%) and low in 85 (51%). The most common cancer diagnosis was colorectal (n=39, 28.8%). Operations performed with the highest frequencies were for enteral access (e.g.gastrostomy) followed by exploratory laparotomy and enterectomy. CD 3+ complications were identified in 31% of the completed operations (n=39/126) and included death (n = 10); abscess (n=4); postoperative hemorrhage (n=3); and anastomotic leak (n=2). The SRS predicted CD 3+ complications with a precision of47% and recall of 73%, resulting in an AUROC of 0.75 and AUPRC of 0.58. When comparing patients with high-risk to low-risk SRS, median overall LOS was 10 vs 7 days (p=0.013), median LOS after operation was 9 vs 6 days (p=0.003), 30-day mortality was 19.0% vs 5.3% (p=0.015), and 30-day postoperative mortality was 13.2% vs 3.3% (p=0.04). Conclusions: In this prospective study, preoperative SRS generated from a trained MLM on real-time EHR data demonstrated an excellent ability to predict individual risk of postoperative complications. In addition, patients with high SRS have longer postoperative LOS and increased mortality. By improving discrimination of risk of postoperative complications and informing on treatment outcomes, integration of the MLM SRS into the consenting process may enable better informed decision making in cancer inpatients.

Development of a machine learning-based risk model for postoperative complications of lung cancer surgery

Prediction of Postoperative Cardiopulmonary Complications after Lung Resection in a Chinese Population: A Machine Learning-Based Study

Machine learning approaches for the prediction of postoperative complication risk in liver resection patients

Risk Factor Analysis and Nomogram Prediction Model Construction of Postoperative Complications of Thoracoscopic Non-Small Cell Lung Cancer

Development of a machine learning algorithm to predict complications of total laparoscopic anterior resection and natural orifice specimen extraction surgery in rectal cancer

Prediction of Surgical Outcome by Modeling Based on Risk Factors of Morbidity After Pulmonary Resection for Lung Cancer in Older Adults.

Predicting Complication Risks after Sleeve Lobectomy for Non-Small Cell Lung Cancer

Analysis of risk factors of postoperative complication for non-small cell lung cancer

Machine learning and postoperative complications: Determining risk before surgery in patients with cancer.

Development of a novel machine learning-based predictive risk calculator for radical cystectomy.

P1.08-004 Prediction of Surgical Outcome by Modeling Based on Risk Factors of Morbidity Following Pulmonary Resection for Lung Cancer in the Elderly

A simple risk scoring system for predicting acute exacerbation of interstitial pneumonia after pulmonary resection in lung cancer patients

Establishing and clinically validating a machine learning model for predicting unplanned reoperation risk in colorectal cancer

Development and validation of a nomogram for predicting pulmonary complications after video-assisted thoracoscopic surgery in elderly patients with lung cancer

Risk model for morbidity and mortality following liver surgery based on a national Japanese database

Machine learning model for prediction of low anterior resection syndrome following laparoscopic anterior resection of rectal cancer: A multicenter study

Analysis of risk factors and establishment of early warning model for recent postoperative complications of colorectal cancer

Nomogram to Predict Postoperative Infectious Complications after Surgery for Colorectal Cancer: a Retrospective Cohort Study in China.

Added Value of Intraoperative Data for Predicting Postoperative Complications: Development and Validation of a MySurgeryRisk Extension

Risk Stratification for Major Postoperative Complications in Patients Undergoing Intra-abdominal General Surgery Using Latent Class Analysis

Development of a Nomogram for Predicting Surgical Site Infection in Patients with Resected Lung Neoplasm Undergoing Minimally Invasive Surgery.