Abstract:Background: Identification of patients with high risk of experiencing inability to walk after surgery is important for surgeons to make therapeutic strategies for patients with metastatic spinal disease. However, there is a lack of clinical tool to assess postoperative ambulatory status for those patients. The emergence of artificial intelligence brings a promising opportunity to develop accurate prediction models. Methods: This study collected 455 patients with metastatic spinal disease who underwent posterior decompressive surgery at three tertiary medical institutions. Of these, 220 patients were collected from one medical institution to form the model derivation cohort, while 89 and 146 patients were collected from two other medical institutions to form the external validation cohorts 1 and 2, respectively. Patients in the model derivation cohort were used to develop and internally validate models. To establish the interactive AI platform, machine learning techniques were used to develop prediction models, including logistic regression (LR), decision tree (DT), random forest (RF), extreme gradient boosting machine (eXGBM), support vector machine (SVM), and neural network (NN). Furthermore, to enhance the resilience of the study’s model, an ensemble machine learning approach was employed using a soft-voting method by combining the results of the above six algorithms. A scoring system incorporating 10 evaluation metrics was used to comprehensively assess the prediction performance of the developed models. The scoring system had a total score of 0 to 60, with higher scores denoting better prediction performance. An interactive AI platform was further deployed via Streamlit. The prediction performance was compared between medical experts and the AI platform in assessing the risk of experiencing postoperative inability to walk among patients with metastatic spinal disease. Results: Among all developed models, the ensemble model outperformed the six other models with the highest score of 57, followed by the eXGBM model (54), SVM model (50), and NN model (50). The ensemble model had the best performance in accuracy and calibration slope, and the second-best performance in precise, recall, specificity, area under the curve (AUC), Brier score, and log loss. The scores of the LR model, RF model, and DT model were 39, 46, and 26, respectively. External validation demonstrated that the ensemble model had an AUC value of 0.873 (95%CI: 0.809-0.936) in the external validation cohort 1 and 0.924 (95%CI: 0.890-0.959) in the external validation cohort 2. In the new ensemble machine learning model excluding the feature of the number of comorbidities, the AUC value was still as high as 0.916 (95% CI: 0.863-0.969). In addition, the AUC values of the new model were 0.880 (95% CI: 0.819-0.940) in the external validation cohort 1 and 0.922 (95% CI: 0.887-0.958) in the external validation cohort 2, indicating favorable generalization of the model. The interactive AI platform was further deployed online based on the final machine learning model, and it was available at https://postoperativeambulatory-izpdr6gsxxwhitr8fubutd.streamlit.app/. By using the AI platform, researchers were able to obtain the individual predicted risk of postoperative inability to walk, gain insights into the key factors influencing the outcome, and find the stratified therapeutic recommendations. The AUC value obtained from the AI platform was significantly higher than the average AUC value achieved by the medical experts ( P <0.001), denoting that the AI platform obviously outperformed the individual medical experts. Conclusions: The study successfully develops and validates an interactive AI platform for evaluating the risk of postoperative loss of ambulatory ability in patients with metastatic spinal disease. This AI platform has the potential to serve as a valuable model for guiding healthcare professionals in implementing surgical plans and ultimately enhancing patient outcomes.

Development of a web-based interpretable model to predict intraoperative massive blood loss among metastatic spinal disease using machine learning techniques: an externally validated observational cohort study

Development and Validation of a Web-Based Artificial Intelligence Prediction Model to Assess Massive Intraoperative Blood Loss for Metastatic Spinal Disease Using Machine Learning Techniques.

Development and validation of a machine learning-based early prediction model for massive intraoperative bleeding in patients with primary hepatic malignancies

Development of Machine Learning Algorithms for Prediction of 30-Day Mortality After Surgery for Spinal Metastasis

Establishment and validation of an interactive artificial intelligence platform to predict postoperative ambulatory status for patients with metastatic spinal disease: a multicenter analysis

Risk of Intraoperative Hemorrhage During Cesarean Scar Ectopic Pregnancy Surgery: Development and Validation of an Interpretable Machine Learning Prediction Modelresearch in Context

Assessment of Hidden Blood Loss in Spinal Metastasis Surgery: A Comprehensive Approach with MRI‐Based Radiomics Models

A Web-Based Calculator to Predict Early Death among Patients with Bone Metastasis Using Machine Learning Techniques: Development and Validation Study

Application of supervised machine learning algorithms to predict the risk of hidden blood loss during the perioperative period in thoracolumbar burst fracture patients complicated with neurological compromise

A Machine Learning-Based Online Prediction Tool for Predicting Short-Term Postoperative Outcomes Following Spinal Tumor Resections

Application of machine learning techniques in real-world research to predict the risk of liver metastasis in rectal cancer

Development and validation of a machine learning model to predict the risk of lymph node metastasis in renal carcinoma

Development and validation of an artificial intelligence mobile application for predicting 30-day mortality in critically ill patients with orthopaedic trauma

Development and Validation of a Machine Learning Algorithm to Predict the Risk of Blood Transfusion after Total Hip Replacement in Patients with Femoral Neck Fractures: A Multicenter Retrospective Cohort Study

Development of machine learning-based prediction models of inadequate postoperative analgesia after noncardiac surgery: a retrospective cohort study

Application of Machine Learning Techniques to Predict Bone Metastasis in Patients with Prostate Cancer

Establishment and validation of an artificial intelligence web application for predicting postoperative in-hospital mortality in patients with hip fracture: a national cohort study of 52 707 cases

A machine learning model based on results of a comprehensive radiological evaluation can predict the prognosis of basal ganglia cerebral hemorrhage treated with neuroendoscopy

Utilizing machine learning algorithms for predicting risk factors for bone metastasis from right-sided colon carcinoma after complete mesocolic excision: a 10-year retrospective multicenter study

Non-invasive prediction of massive transfusion during surgery using intraoperative hemodynamic monitoring data

An External-Validated Prediction Model to Predict Lung Metastasis among Osteosarcoma: A Multicenter Analysis Based on Machine Learning