Abstract:Importance Artificial intelligence (AI) enables powerful models for establishment of clinical diagnostic and prognostic tools for hip fractures; however the performance and potential impact of these newly developed algorithms are currently unknown. Objective To evaluate the performance of AI algorithms designed to diagnose hip fractures on radiographs and predict postoperative clinical outcomes following hip fracture surgery relative to current practices. Data Sources A systematic review of the literature was performed using the MEDLINE, Embase, and Cochrane Library databases for all articles published from database inception to January 23, 2023. A manual reference search of included articles was also undertaken to identify any additional relevant articles. Study Selection Studies developing machine learning (ML) models for the diagnosis of hip fractures from hip or pelvic radiographs or to predict any postoperative patient outcome following hip fracture surgery were included. Data Extraction and Synthesis This study followed the Preferred Reporting Items for Systematic Reviews and Meta-analyses and was registered with PROSPERO. Eligible full-text articles were evaluated and relevant data extracted independently using a template data extraction form. For studies that predicted postoperative outcomes, the performance of traditional predictive statistical models, either multivariable logistic or linear regression, was recorded and compared with the performance of the best ML model on the same out-of-sample data set. Main Outcomes and Measures Diagnostic accuracy of AI models was compared with the diagnostic accuracy of expert clinicians using odds ratios (ORs) with 95% CIs. Areas under the curve for postoperative outcome prediction between traditional statistical models (multivariable linear or logistic regression) and ML models were compared. Results Of 39 studies that met all criteria and were included in this analysis, 18 (46.2%) used AI models to diagnose hip fractures on plain radiographs and 21 (53.8%) used AI models to predict patient outcomes following hip fracture surgery. A total of 39 598 plain radiographs and 714 939 hip fractures were used for training, validating, and testing ML models specific to diagnosis and postoperative outcome prediction, respectively. Mortality and length of hospital stay were the most predicted outcomes. On pooled data analysis, compared with clinicians, the OR for diagnostic error of ML models was 0.79 (95% CI, 0.48-1.31; P = .36; I 2 = 60%) for hip fracture radiographs. For the ML models, the mean (SD) sensitivity was 89.3% (8.5%), specificity was 87.5% (9.9%), and F1 score was 0.90 (0.06). The mean area under the curve for mortality prediction was 0.84 with ML models compared with 0.79 for alternative controls ( P = .09). Conclusions and Relevance The findings of this systematic review and meta-analysis suggest that the potential applications of AI to aid with diagnosis from hip radiographs are promising. The performance of AI in diagnosing hip fractures was comparable with that of expert radiologists and surgeons. However, current implementations of AI for outcome prediction do not seem to provide substantial benefit over traditional multivariable predictive statistics.

Accuracy of machine learning to predict the outcomes of shoulder arthroplasty: a systematic review

Artificial Intelligence for Hip Fracture Detection and Outcome Prediction

Artificial intelligence in total and unicompartmental knee arthroplasty

Artificial Intelligence Models Are Limited in Predicting Clinical Outcomes Following Hip Arthroscopy: A Systematic Review

Artificial intelligence in knee arthroplasty: current concept of the available clinical applications

Reliability of artificial intelligence in predicting total knee arthroplasty component sizes: a systematic review

Artificial Intelligence Machine Learning Algorithms Versus Standard Linear Demographic Analysis in Predicting Implant Size of Anatomic and Reverse Total Shoulder Arthroplasty

Advanced technology in shoulder arthroplasty surgery: Artificial intelligence, extended reality, and robotics

Applications of artificial intelligence and machine learning for the hip and knee surgeon: current state and implications for the future

Applications of artificial intelligence in Orthopaedic surgery: A systematic review and meta-analysis

Editorial Commentary: Experts in Shoulder Surgery Do Not Consistently Detect Artificial Intelligence-Generated Scientific Abstracts

Supervised machine learning for the prediction of post‐operative clinical outcomes of hip and knee replacements: a review

Artificial Intelligence and Machine Learning in Rotator Cuff Tears

Application of Artificial Intelligence in Shoulder Pathology

Diagnostic accuracy and potential covariates of artificial intelligence for diagnosing orthopedic fractures: a systematic literature review and meta-analysis

Current clinical applications of artificial intelligence in shoulder surgery: what the busy shoulder surgeon needs to know and what's coming next

Effect of Artificial Intelligence or Machine Learning on Prediction of Hip Fracture Risk: Systematic Review

Artificial intelligence and machine learning on diagnosis and classification of hip fracture: systematic review

Utility of Machine Learning, Natural Language Processing, and Artificial Intelligence in Predicting Hospital Readmissions After Orthopaedic Surgery: A Systematic Review and Meta-Analysis

The utility of machine learning algorithms for the prediction of patient-reported outcome measures following primary hip and knee total joint arthroplasty

An Overview of Machine Learning in Orthopedic Surgery: An Educational Paper