Abstract:Background: Identification of patients with high risk of experiencing inability to walk after surgery is important for surgeons to make therapeutic strategies for patients with metastatic spinal disease. However, there is a lack of clinical tool to assess postoperative ambulatory status for those patients. The emergence of artificial intelligence brings a promising opportunity to develop accurate prediction models. Methods: This study collected 455 patients with metastatic spinal disease who underwent posterior decompressive surgery at three tertiary medical institutions. Of these, 220 patients were collected from one medical institution to form the model derivation cohort, while 89 and 146 patients were collected from two other medical institutions to form the external validation cohorts 1 and 2, respectively. Patients in the model derivation cohort were used to develop and internally validate models. To establish the interactive AI platform, machine learning techniques were used to develop prediction models, including logistic regression (LR), decision tree (DT), random forest (RF), extreme gradient boosting machine (eXGBM), support vector machine (SVM), and neural network (NN). Furthermore, to enhance the resilience of the study’s model, an ensemble machine learning approach was employed using a soft-voting method by combining the results of the above six algorithms. A scoring system incorporating 10 evaluation metrics was used to comprehensively assess the prediction performance of the developed models. The scoring system had a total score of 0 to 60, with higher scores denoting better prediction performance. An interactive AI platform was further deployed via Streamlit. The prediction performance was compared between medical experts and the AI platform in assessing the risk of experiencing postoperative inability to walk among patients with metastatic spinal disease. Results: Among all developed models, the ensemble model outperformed the six other models with the highest score of 57, followed by the eXGBM model (54), SVM model (50), and NN model (50). The ensemble model had the best performance in accuracy and calibration slope, and the second-best performance in precise, recall, specificity, area under the curve (AUC), Brier score, and log loss. The scores of the LR model, RF model, and DT model were 39, 46, and 26, respectively. External validation demonstrated that the ensemble model had an AUC value of 0.873 (95%CI: 0.809-0.936) in the external validation cohort 1 and 0.924 (95%CI: 0.890-0.959) in the external validation cohort 2. In the new ensemble machine learning model excluding the feature of the number of comorbidities, the AUC value was still as high as 0.916 (95% CI: 0.863-0.969). In addition, the AUC values of the new model were 0.880 (95% CI: 0.819-0.940) in the external validation cohort 1 and 0.922 (95% CI: 0.887-0.958) in the external validation cohort 2, indicating favorable generalization of the model. The interactive AI platform was further deployed online based on the final machine learning model, and it was available at https://postoperativeambulatory-izpdr6gsxxwhitr8fubutd.streamlit.app/. By using the AI platform, researchers were able to obtain the individual predicted risk of postoperative inability to walk, gain insights into the key factors influencing the outcome, and find the stratified therapeutic recommendations. The AUC value obtained from the AI platform was significantly higher than the average AUC value achieved by the medical experts ( P <0.001), denoting that the AI platform obviously outperformed the individual medical experts. Conclusions: The study successfully develops and validates an interactive AI platform for evaluating the risk of postoperative loss of ambulatory ability in patients with metastatic spinal disease. This AI platform has the potential to serve as a valuable model for guiding healthcare professionals in implementing surgical plans and ultimately enhancing patient outcomes.

Prognosticating prosthetic ambulation ability in people with lower limb amputation in early post-operative phase

Predicting Prosthetic Mobility at Discharge From Rehabilitation Following Major Amputation in Vascular Surgery

Multivariate prediction of upper limb prosthesis acceptance or rejection

Prediction model for delayed behavior of early ambulation after surgery for varicose veins of lower extremity: a prospective case‒control study

Machine Learning Model for Predicting Walking Ability in Lower Limb Amputees

Establishment and validation of an interactive artificial intelligence platform to predict postoperative ambulatory status for patients with metastatic spinal disease: a multicenter analysis

A machine learning-based prediction model pre-operatively for functional recovery after 1-year of hip fracture surgery in older people

The utility of machine learning algorithms for the prediction of patient-reported outcome measures following primary hip and knee total joint arthroplasty

Development and external validation of a prediction model for digit replantation failure after traumatic amputations based on a prospective multicenter cohort

A novel tool for predicting the survival of endoprosthesis used for reconstruction of the knee following tumor resection: a retrospective cohort study

Early Prediction of Poststroke Rehabilitation Outcomes Using Wearable Sensors

Locomotion Prediction for Lower Limb Prostheses in Complex Environments Via Semg and Inertial Sensors

Prognostic factors of a satisfactory functional result in patients with unilateral amputations of the upper limb above the wrist that use an upper limb prosthesis

Prosthesis Usage and Functional Status in Upper Limb Amputees: A Prospective Cross-Sectional Study

Predicting patient-reported outcomes following hip and knee replacement surgery using supervised machine learning

Early prediction of functional mobility severity after stroke: two key milestones

Prosthetic Outcomes after Amputation and the Impact of Mobility Level on Survival

Predicting post-stroke motor recovery of upper extremity using clinical variables and performance assays: A prospective cohort study protocol

Returning to work after dysvascular lower limb amputation—A novel multivariate approach to examine relative contributions of biopsychosocial predictors

Machine Learning Models Leveraging Smartphone-Based Patient Mobility Data Can Accurately Predict Functional Outcomes After Spine Surgery

Prediction of poststroke independent walking using machine learning: a retrospective study