Abstract:Background Given the intricate and grave nature of trauma-related injuries in ICU settings, it is imperative to develop and deploy reliable predictive tools that can aid in the early identification of high-risk patients who are at risk of early death. The objective of this study is to create and validate an artificial intelligence (AI) model that can accurately predict early mortality among critical fracture patients. Methods A total of 2662 critically ill patients with orthopaedic trauma were included from the MIMIC III database. Early mortality was defined as death within 30 days in this study. The patients were randomly divided into a model training cohort and a model validation cohort. Various algorithms, including logistic regression (LR), extreme gradient boosting machine (eXGBM), decision tree (DT), support vector machine (SVM), random forest (RF), and neural network (NN), were employed. Evaluation metrics, including discrimination and calibration, were used to develop a comprehensive scoring system ranging from 0 to 60, with higher scores indicating better prediction performance. Furthermore, external validation was carried out using 131 patients from two tertiary hospitals. The optimal model was deployed as an internet-based AI tool. Results Among all models, the eXGBM demonstrated the highest area under the curve (AUC) value (0.974, 95%CI: 0.959-0.983), followed by the RF model (0.951, 95%CI: 0.935-0.967) and the NN model (0.922, 95%CI: 0.905-0.941). Additionally, the eXGBM model outperformed other models in terms of accuracy (0.915), precision (0.906), recall (0.926), F1 score (0.916), Brier score (0.062), log loss (0.210), and discrimination slope (0.767). Based on the scoring system, the eXGBM model achieved the highest score (53), followed by RF (42) and NN (39). The LR, DT, and SVM models obtained scores of 28, 18, and 32, respectively. Decision curve analysis further confirmed the superior clinical net benefits of the eXGBM model. External validation of the model achieved an AUC value of 0.913 (95%CI: 0.878-0.948). Consequently, the model was deployed on the Internet at https://30-daymortalityincriticallyillpatients-fnfsynbpbp6rgineaspuim.streamlit.app/ , allowing users to input patient features and obtain predicted risks of early mortality among critical fracture patients. Furthermore, the AI model successfully stratified patients into low or high risk of early mortality based on a predefined threshold and provided recommendations for appropriate therapeutic interventions. Conclusion This study successfully develops and validates an AI model, with the eXGBM algorithm demonstrating the highest predictive performance for early mortality in critical fracture patients. By deploying the model as a web-based AI application, healthcare professionals can easily access the tool, enabling them to predict 30-day mortality and aiding in the identification and management of high-risk patients among those critically ill with orthopedic trauma.

Analysis of machine learning algorithmic models for the prediction of vital status at six months after hip fracture in patients older than 74 years

Development and Internal Validation of a Multivariable Prediction Model for Mortality After Hip Fracture with Machine Learning Techniques

Machine learning‐based mortality prediction in hip fracture patients using biomarkers

A novel machine-learning algorithm for predicting mortality risk after hip fracture surgery

Predicting 1-Year Mortality after Hip Fracture Surgery: An Evaluation of Multiple Machine Learning Approaches

Development and Validation of Multivariable Prediction Models for In-Hospital Death, 30-Day Death, and Change in Residence After Hip Fracture Surgery and the “Stratify-Hip” Algorithm

Establishment and validation of an artificial intelligence web application for predicting postoperative in-hospital mortality in patients with hip fracture: a national cohort study of 52 707 cases

A machine learning-based prediction model pre-operatively for functional recovery after 1-year of hip fracture surgery in older people

Predictive Value of Machine Learning Models in Postoperative Mortality of Older Adults Patients with Hip Fracture: A Systematic Review and Meta-analysis

Predictive Model of Gait Recovery at One Month after Hip Fracture from a National Cohort of 25,607 Patients: The Hip Fracture Prognosis (HF-Prognosis) Tool

Systematic review of multivariable prognostic models for outcomes at least 30 days after hip fracture finds 18 mortality models but no nonmortality models warranting validation

Development and validation of a prognostic scoring system for 1-year mortality in older patients with hip fractures

Development and internal validation of a machine-learning-developed model for predicting 1-year mortality after fragility hip fracture

Predictive model for a second hip fracture occurrence using natural language processing and machine learning on electronic health records

Development of a Mortality Risk Model in Elderly Hip Fracture Patients by Different Analytical Approaches

Development and internal validation of a clinical prediction model using machine learning algorithms for 90 day and 2 year mortality in femoral neck fracture patients aged 65 years or above

Development and Validation of a Machine Learning Algorithm to Predict the Risk of Blood Transfusion after Total Hip Replacement in Patients with Femoral Neck Fractures: A Multicenter Retrospective Cohort Study

Predictive characteristics and model development for acute heart failure preceding hip fracture surgery in elderly hypertensive patients: a retrospective machine learning approach

A New Random Forest Algorithm-Based Prediction Model of Post-operative Mortality in Geriatric Patients With Hip Fractures

Machine Learning Prediction Model to Predict Length of Stay of Patients Undergoing Hip or Knee Arthroplasties: Results from a High-Volume Single-Center Multivariate Analysis

Development and validation of an artificial intelligence mobile application for predicting 30-day mortality in critically ill patients with orthopaedic trauma