Anouk van de Kuit,Jacobien H F Oosterhoff,Hidde Dijkstra,Sheila Sprague,Sofia Bzovsky,Mohit Bhandari,Marc Swiontkowski,Emil H Schemitsch,Frank F A IJpma,Rudolf W Poolman,Job N Doornberg,Laurent A M Hendrickx,, the Machine Learning Consortium and FAITH Investigators,Anne Eva J Bulstra,J Carel Goslings,Ruurd L Jaarsma,Kyle J Jeray,Gino M M J Kerkhoffs,Brad Petrisor,David Ring,David Sanders,Paul Tornetta 3rd,Stephen D Walter,P J Devereaux,Gordon Guyatt,Lehana Thabane,Martin J Heetveld,Susan Liew,Gregory J Della Rocca,Richard E Buckley,Robert McCormack,Todd M Oliver,Michiel J M Segers,Amar Rangan,Martin Richardson,Gerard P Slobogean,Taryn Scott,Julie Agel,Alisha Garibaldi,Qi Zhou,Diane Heels-Ansdell,Helena Viveiros,Stephanie M Zielinski,Esther M M Van Lieshout,Herman Johal,Birgit C Hanusch,Kyle Jeray,Paula McKay,Marilyn Swinton,Mark Gichuru,Lisa Buckingham,Aravin Duraikannan,Deborah Maddock,Nicole Simunovic,Esther M M,Van Lieshout,Lucksy Kottam,Rachel Clarkson,Robert Haverlag

Abstract:Background: Femoral neck fractures are common and are frequently treated with internal fixation. A major disadvantage of internal fixation is the substantially high number of conversions to arthroplasty because of nonunion, malunion, avascular necrosis, or implant failure. A clinical prediction model identifying patients at high risk of conversion to arthroplasty may help clinicians in selecting patients who could have benefited from arthroplasty initially. Question/purpose: What is the predictive performance of a machine-learning (ML) algorithm to predict conversion to arthroplasty within 24 months after internal fixation in patients with femoral neck fractures? Methods: We included 875 patients from the Fixation using Alternative Implants for the Treatment of Hip fractures (FAITH) trial. The FAITH trial consisted of patients with low-energy femoral neck fractures who were randomly assigned to receive a sliding hip screw or cancellous screws for internal fixation. Of these patients, 18% (155 of 875) underwent conversion to THA or hemiarthroplasty within the first 24 months. All patients were randomly divided into a training set (80%) and test set (20%). First, we identified 27 potential patient and fracture characteristics that may have been associated with our primary outcome, based on biomechanical rationale and previous studies. Then, random forest algorithms (an ML learning, decision tree-based algorithm that selects variables) identified 10 predictors of conversion: BMI, cardiac disease, Garden classification, use of cardiac medication, use of pulmonary medication, age, lung disease, osteoarthritis, sex, and the level of the fracture line. Based on these variables, five different ML algorithms were trained to identify patterns related to conversion. The predictive performance of these trained ML algorithms was assessed on the training and test sets based on the following performance measures: (1) discrimination (the model's ability to distinguish patients who had conversion from those who did not; expressed with the area under the receiver operating characteristic curve [AUC]), (2) calibration (the plotted estimated versus the observed probabilities; expressed with the calibration curve intercept and slope), and (3) the overall model performance (Brier score: a composite of discrimination and calibration). Results: None of the five ML algorithms performed well in predicting conversion to arthroplasty in the training set and the test set; AUCs of the algorithms in the training set ranged from 0.57 to 0.64, slopes of calibration plots ranged from 0.53 to 0.82, calibration intercepts ranged from -0.04 to 0.05, and Brier scores ranged from 0.14 to 0.15. The algorithms were further evaluated in the test set; AUCs ranged from 0.49 to 0.73, calibration slopes ranged from 0.17 to 1.29, calibration intercepts ranged from -1.28 to 0.34, and Brier scores ranged from 0.13 to 0.15. Conclusion: The predictive performance of the trained algorithms was poor, despite the use of one of the best datasets available worldwide on this subject. If the current dataset consisted of different variables or more patients, the performance may have been better. Also, various reasons for conversion to arthroplasty were pooled in this study, but the separate prediction of underlying pathology (such as, avascular necrosis or nonunion) may be more precise. Finally, it may be possible that it is inherently difficult to predict conversion to arthroplasty based on preoperative variables alone. Therefore, future studies should aim to include more variables and to differentiate between the various reasons for arthroplasty. Level of evidence: Level III, prognostic study.

Machine Learning Did Not Outperform Conventional Competing Risk Modeling to Predict Revision Arthroplasty

A Systematic Approach to Predicting the Risk of Unicompartmental Knee Arthroplasty Revision.

Limited clinical utility of a machine learning revision prediction model based on a national hip arthroscopy registry

Prediction of 30-Day Mortality Following Revision Total Hip and Knee Arthroplasty: Machine Learning Algorithms Outperform CARDE-B, 5-Item, and 6-Item Modified Frailty Index Risk Scores

Machine Learning Models of Postoperative Atrial Fibrillation Prediction After Cardiac Surgery.

A Novel Machine Learning Model to Predict Revision ACL Reconstruction Failure in the MARS Cohort

Prediction of Early Adverse Events After THA: A Comparison of Different Machine-Learning Strategies Based on 262,356 Observations From the Nordic Arthroplasty Register Association (NARA) Dataset

Predicting 30-day unplanned hospital readmission after revision total knee arthroplasty: machine learning model analysis of a national patient cohort

Predictive Value of Machine Learning Models in Postoperative Mortality of Older Adults Patients with Hip Fracture: A Systematic Review and Meta-analysis

Methodology and development of a machine learning probability calculator: Data heterogeneity limits ability to predict recurrence after arthroscopic Bankart repair

Machine Learning-Based Individualized Survival Prediction Model for Total Knee Replacement in Osteoarthritis: Data From the Osteoarthritis Initiative

Predicting prolonged length of stay following revision total knee arthroplasty: A national database analysis using machine learning models

Applying models of care for total hip and knee arthroplasty: External validation of a published predictive model to identify extended stay risk prior to lower-limb arthroplasty

The utility of machine learning algorithms for the prediction of patient-reported outcome measures following primary hip and knee total joint arthroplasty

Patients With Femoral Neck Fractures Are at Risk for Conversion to Arthroplasty After Internal Fixation: A Machine-learning Algorithm

Machine learning model outperforms the ACS Risk Calculator in predicting non‐home discharge following primary total knee arthroplasty

Supervised machine learning for the prediction of post‐operative clinical outcomes of hip and knee replacements: a review

Machine learning prediction models in orthopedic surgery: A systematic review in transparent reporting

Prediction model for an early revision for dislocation after primary total hip arthroplasty

Graft Failure and Contralateral ACL Injuries After Primary ACL Reconstruction: An Analysis of Risk Factors Using Interpretable Machine Learning

Predicting patient-reported outcomes following hip and knee replacement surgery using supervised machine learning