Abstract:Background: Identification of patients with high risk of experiencing inability to walk after surgery is important for surgeons to make therapeutic strategies for patients with metastatic spinal disease. However, there is a lack of clinical tool to assess postoperative ambulatory status for those patients. The emergence of artificial intelligence brings a promising opportunity to develop accurate prediction models. Methods: This study collected 455 patients with metastatic spinal disease who underwent posterior decompressive surgery at three tertiary medical institutions. Of these, 220 patients were collected from one medical institution to form the model derivation cohort, while 89 and 146 patients were collected from two other medical institutions to form the external validation cohorts 1 and 2, respectively. Patients in the model derivation cohort were used to develop and internally validate models. To establish the interactive AI platform, machine learning techniques were used to develop prediction models, including logistic regression (LR), decision tree (DT), random forest (RF), extreme gradient boosting machine (eXGBM), support vector machine (SVM), and neural network (NN). Furthermore, to enhance the resilience of the study’s model, an ensemble machine learning approach was employed using a soft-voting method by combining the results of the above six algorithms. A scoring system incorporating 10 evaluation metrics was used to comprehensively assess the prediction performance of the developed models. The scoring system had a total score of 0 to 60, with higher scores denoting better prediction performance. An interactive AI platform was further deployed via Streamlit. The prediction performance was compared between medical experts and the AI platform in assessing the risk of experiencing postoperative inability to walk among patients with metastatic spinal disease. Results: Among all developed models, the ensemble model outperformed the six other models with the highest score of 57, followed by the eXGBM model (54), SVM model (50), and NN model (50). The ensemble model had the best performance in accuracy and calibration slope, and the second-best performance in precise, recall, specificity, area under the curve (AUC), Brier score, and log loss. The scores of the LR model, RF model, and DT model were 39, 46, and 26, respectively. External validation demonstrated that the ensemble model had an AUC value of 0.873 (95%CI: 0.809-0.936) in the external validation cohort 1 and 0.924 (95%CI: 0.890-0.959) in the external validation cohort 2. In the new ensemble machine learning model excluding the feature of the number of comorbidities, the AUC value was still as high as 0.916 (95% CI: 0.863-0.969). In addition, the AUC values of the new model were 0.880 (95% CI: 0.819-0.940) in the external validation cohort 1 and 0.922 (95% CI: 0.887-0.958) in the external validation cohort 2, indicating favorable generalization of the model. The interactive AI platform was further deployed online based on the final machine learning model, and it was available at https://postoperativeambulatory-izpdr6gsxxwhitr8fubutd.streamlit.app/. By using the AI platform, researchers were able to obtain the individual predicted risk of postoperative inability to walk, gain insights into the key factors influencing the outcome, and find the stratified therapeutic recommendations. The AUC value obtained from the AI platform was significantly higher than the average AUC value achieved by the medical experts ( P <0.001), denoting that the AI platform obviously outperformed the individual medical experts. Conclusions: The study successfully develops and validates an interactive AI platform for evaluating the risk of postoperative loss of ambulatory ability in patients with metastatic spinal disease. This AI platform has the potential to serve as a valuable model for guiding healthcare professionals in implementing surgical plans and ultimately enhancing patient outcomes.

Risk stratification in hip and knee replacement using Artificial Intelligence: a dual centre study to support the utility of high-volume low-complexity hubs and ambulatory surgery centres.

A Systematic Approach to Predicting the Risk of Unicompartmental Knee Arthroplasty Revision.

Using Artificial Intelligence to Revolutionise the Patient Care Pathway in Hip and Knee Arthroplasty (ARCHERY): Protocol for the Development of a Clinical Prediction Model

Artificial Intelligence Models Are Limited in Predicting Clinical Outcomes Following Hip Arthroscopy: A Systematic Review

Artificial intelligence in total and unicompartmental knee arthroplasty

Applications of artificial intelligence and machine learning for the hip and knee surgeon: current state and implications for the future

Establishment and validation of an artificial intelligence web application for predicting postoperative in-hospital mortality in patients with hip fracture: a national cohort study of 52 707 cases

Artificial intelligence in knee arthroplasty: current concept of the available clinical applications

Artificial Intelligence for Hip Fracture Detection and Outcome Prediction

Artificial Intelligence-Based Prediction of Lower Extremity Deep Vein Thrombosis Risk After Knee/Hip Arthroplasty

Operative or Nonoperative Treatment is Predicted Accurately for Patients Who Have Hip Complaints Consulting an Orthopedic Surgeon Using Machine Learning Algorithms Trained With Prehospital Acquired History-Taking Data

Establishment and validation of an interactive artificial intelligence platform to predict postoperative ambulatory status for patients with metastatic spinal disease: a multicenter analysis

Development and Validation of an Artificial Intelligence Preoperative Planning System for Total Hip Arthroplasty

Risk assessment and clinical prediction model of planned transfer to the ICU after hip arthroplasty in elderly individuals

Predicting the Risk of Total Hip Replacement by Using A Deep Learning Algorithm on Plain Pelvic Radiographs: Diagnostic Study

Use of natural language processing techniques to predict patient selection for total hip and knee arthroplasty from radiology reports

Is it feasible to develop a supervised learning algorithm incorporating spinopelvic mobility to predict impingement in patients undergoing total hip arthroplasty?

Applying models of care for total hip and knee arthroplasty: External validation of a published predictive model to identify extended stay risk prior to lower-limb arthroplasty

The utility of machine learning algorithms for the prediction of patient-reported outcome measures following primary hip and knee total joint arthroplasty

Accuracy analysis of artificial intelligence-assisted three-dimensional preoperative planning in total hip replacement

Enabling Personalized Medicine in Orthopaedic Surgery Through Artificial Intelligence: A Critical Analysis Review