Internal and External Validation of Machine Learning Models for Predicting Acute Kidney Injury Following Non-Cardiac Surgery Using Open Datasets

Sang-Wook Lee,Jaewon Jang,Woo-Young Seo,Donghee Lee,Sung-Hoon Kim
DOI: https://doi.org/10.3390/jpm14060587
IF: 3.5083
2024-05-31
Journal of Personalized Medicine
Abstract:This study developed and validated a machine learning model to accurately predict acute kidney injury (AKI) after non-cardiac surgery, aiming to improve patient outcomes by assessing its clinical feasibility and generalizability. We conducted a retrospective cohort study using data from 76,032 adults who underwent non-cardiac surgery at a single tertiary medical center between March 2019 and February 2021, and used data from 5512 patients from the VitalDB open dataset for external model validation. The predictive variables for model training consisted of demographic, preoperative laboratory, and intraoperative data, including calculated statistical values such as the minimum, maximum, and mean intraoperative blood pressure. When predicting postoperative AKI, our gradient boosting machine model incorporating all the variables achieved the best results, with AUROC values of 0.868 and 0.757 for the internal and external validations using the VitalDB dataset, respectively. The model using intraoperative data performed best in internal validation, while the model with preoperative data excelled in external validation. In this study, we developed a predictive model for postoperative AKI in adult patients undergoing non-cardiac surgery using preoperative and intraoperative data, and external validation demonstrated the efficacy of open datasets for generalization in medical artificial modeling research.
medicine, general & internal,health care sciences & services
What problem does this paper attempt to address?
The paper aims to address the following issues: 1. **Development of Predictive Model**: The study developed a machine learning model to accurately predict acute kidney injury (AKI) after non-cardiac surgery, aiming to improve patient clinical outcomes. 2. **Internal and External Validation**: The clinical feasibility and generalization ability of the model were evaluated through internal and external validation. External validation used the publicly available dataset VitalDB to demonstrate the model's effectiveness across different institutions. 3. **Improving Medical Resource Allocation Efficiency**: By predicting the occurrence of AKI preoperatively, appropriate postoperative medical resources can be allocated in advance, optimizing patient treatment processes and reducing medical costs. The paper demonstrates the effectiveness of predicting AKI by utilizing preoperative and intraoperative data, especially important physiological parameters such as blood pressure. It also shows the model's good generalization ability through external validation, providing valuable references for future medical AI research.