Abstract:Background: Early unplanned hospital readmissions are associated with increased harm to patients, increased medical costs, and negative hospital reputation. With the identification of at-risk patients, a crucial step toward improving care, appropriate interventions can be adopted to prevent readmission. This study aimed to build machine learning models to predict 14-day unplanned readmissions. Methods: We conducted a retrospective cohort study on 37,091 consecutive hospitalized adult patients with 55,933 discharges between September 1, 2018, and August 31, 2019, in an 1193-bed university hospital. Patients who were aged < 20 years, were admitted for cancer-related treatment, participated in clinical trial, were discharged against medical advice, died during admission, or lived abroad were excluded. Predictors for analysis included 7 categories of variables extracted from hospital's medical record dataset. In total, four machine learning algorithms, namely logistic regression, random forest, extreme gradient boosting, and categorical boosting, were used to build classifiers for prediction. The performance of prediction models for 14-day unplanned readmission risk was evaluated using precision, recall, F1-score, area under the receiver operating characteristic curve (AUROC), and area under the precision-recall curve (AUPRC). Results: In total, 24,722 patients were included for the analysis. The mean age of the cohort was 57.34 ± 18.13 years. The 14-day unplanned readmission rate was 1.22%. Among the 4 machine learning algorithms selected, Catboost had the best average performance in fivefold cross-validation (precision: 0.9377, recall: 0.5333, F1-score: 0.6780, AUROC: 0.9903, and AUPRC: 0.7515). After incorporating 21 most influential features in the Catboost model, its performance improved (precision: 0.9470, recall: 0.5600, F1-score: 0.7010, AUROC: 0.9909, and AUPRC: 0.7711). Conclusions: Our models reliably predicted 14-day unplanned readmissions and were explainable. They can be used to identify patients with a high risk of unplanned readmission based on influential features, particularly features related to diagnoses. The operation of the models with physiological indicators also corresponded to clinical experience and literature. Identifying patients at high risk with these models can enable early discharge planning and transitional care to prevent readmissions. Further studies should include additional features that may enable further sensitivity in identifying patients at a risk of early unplanned readmissions.

Application of a Machine Learning Algorithm to Develop and Validate a Prediction Model for Ambulatory Non-Arrivals

Cost-sensitive Deep Learning for Early Readmission Prediction at A Major Hospital

Predicting Hospital Readmission Via Cost-Sensitive Deep Learning

Enhancing Health Equity by Predicting Missed Appointments in Health Care: Machine Learning Study

Predictive modeling for 14-day unplanned hospital readmission risk by using machine learning algorithms

Forecasting Patient Early Readmission from Irish Hospital Discharge Records Using Conventional Machine Learning Models

Development and Validation of a Machine Learning Model Integrated with the Clinical Workflow for Inpatient Discharge Date Prediction

Early Prediction of Unplanned 30-Day Hospital Readmission: Model Development and Retrospective Data Analysis

Reducing Hospital Readmissions by Integrating Empirical Prediction with Resource Optimization

Efficient Prediction of Missed Clinical Appointment Using Machine Learning

Predicting Admissions From a Paediatric Emergency Department - Protocol for Developing and Validating a Low-Dimensional Machine Learning Prediction Model

Machine learning-based prediction models for patients no-show in online outpatient appointments

Readmission prediction using deep learning on electronic health records

Advances in Prediction of Readmission Rates Using Long Term Short Term Memory Networks on Healthcare Insurance Data

Using Machine Learning Approaches for Emergency Room Visit Prediction Based on Electronic Health Record Data

Aspiring to clinical significance: Insights from developing and evaluating a machine learning model to predict emergency department return visit admissions

Application of machine learning in predicting hospital readmissions: a scoping review of the literature

A predictive analytics approach to reducing avoidable hospital readmission

Improving patient flow through hospitals with machine learning based discharge prediction

Development and Validation of a Machine Learning Algorithm Using Clinical Pages to Predict Imminent Clinical Deterioration

Predicting Hospital Readmission: A Joint Ensemble-Learning Model.