Predicting Antibiotic Resistance in ICUs Patients by Applying Machine Learning in Vietnam
Viet Tran Quoc,Dung Nguyen Thi Ngoc,Trung Nguyen Hoang,Hoa Vu Thi,Minh Tong Duc,Thanh Do Pham Nguyet,Thanh Nguyen Van,Diep Ho Ngoc,Giang Vu Son,Thanh Bui Duc
DOI: https://doi.org/10.2147/IDR.S415885
2023-08-23
Infection and Drug Resistance
Abstract:Viet Tran Quoc, 1 Dung Nguyen Thi Ngoc, 2, 3 Trung Nguyen Hoang, 4 Hoa Vu Thi, 4 Minh Tong Duc, 4 Thanh Do Pham Nguyet, 2 Thanh Nguyen Van, 5 Diep Ho Ngoc, 2 Giang Vu Son, 6 Thanh Bui Duc 7 1 Intensive Care Unit, Military Hospital 175, Ho Chi Minh City, Vietnam; 2 Department of Military Science and Training, Military Hospital 175, Ho Chi Minh City, Vietnam; 3 Hanoi University of Public Health, Hanoi, Vietnam; 4 Department of Military Hygiene, Vietnam Military Medical University, Hanoi, Vietnam; 5 Department of General Planning, Military Hospital 175, Ho Chi Minh City, Vietnam; 6 Department of Personnel, Military Hospital 175, Ho Chi Minh City, Vietnam; 7 Institute of Trauma and Orthopedics, Military hospital 175, Ho Chi Minh City, Vietnam Correspondence: Thanh Bui Duc, Military Hospital 175, 786 Nguyen Kiem, 3 Ward, Go Vap District, Ho Chi Minh City, Vietnam, Tel +84 975 430 258, Email Introduction: Artificial Intelligence (AI) and machine learning (ML) are used extensively in HICs to detect and control antibiotic resistance (AMR) in laboratories and clinical institutions. ML is designed to predict outcome variables using an algorithm to enable "machines" to learn the "rules" from the data. ML is increasingly being applied in intensive care units to identify AMR and to assist empiric antibiotic therapy. This study aimed to evaluate the performance of ML models for predicting AMR bacteria and resistance to antibiotics in two Vietnamese hospitals. Patients and Methods: A cross-sectional study combined with retrospective was conducted from 1st January 2020 to 30th June 2022. Five models were developed to predict antibiotic resistance of bacterial infections of ICU patients. Two datasets were prepared to predict AMR bacteria and antibiotics with ML models. The performance of the prediction models was evaluated by various indicators (sensitivity, specificity, precision, accuracy, F1-score, PRC, AuROC, and NormMCC) to determine the optimal time point for data selection. Python version 3.8 was used for statistical analyses. Results: The accuracy, F1-score, AuROC, and normMMC of LightGBM, XGBoost, and Random Forest models were higher than those of other models in both datasets. In both datasets 1 and 2, accuracy, F1-score, AuROC and normMCC of the XGBoost model were the highest among five models (from 0.890 to 1.000). Only Random Forest models had specificity scores higher than 0.850. High scores of sensitivity, accuracy, precision, F1-score, and normMCC indicated that the models were making accurate predictions for datasets 1 and 2. Conclusion: XGBoost, LightGBM, and Random Forest were the best-performed machine learning models to predict antibiotic resistance of bacterial infections of ICUs patients using the patients' EMRs. Keywords: antibiotic resistance, machine learning, XGBoost, LightGBM, random forest Antibiotic resistance (AMR) is one of ten major global health challenge facing both high-income countries (HICs) and low- and middle-income countries (LMICs). 1 Two main factors, included the inappropriate use of antibiotics in the community and the misprescription of broad-spectrum antibiotics in health-care settings, are contributing to the development of AMR. 2,3 In hospitals, intensive care units (ICUs), where the mortality rate of infections could be as high as 80%, and the overuse of antibiotics is common, are the greatest threat of AMR. 4 In previous study conducted in 1265 ICUs from 75 countries, nearly half of the patients admitted to these units found hospital-acquired infections. 5 In Vietnam, a high incidence of nosocomial infections and AMR were found among hospitalized patients, especially in ICUs. 6–8 Antibiotic susceptibility tests in hospitals usually require 36–72 hours for sample cultivation and identification of bacteria. 9 Therefore, ICU physicians often prescribe antibiotics for prophylaxis based on their experience and the patient's clinical symptoms rather than laboratory test results as known as empiric therapy. 10 However, during empiric therapy, two main types of errors might occur, including the prescription of inefficient antibiotics and the prescription of antibiotics with coverage that is too broad. In recent years, artificial Intelligence (AI) and machine learning (ML) are used extensively in HICs to detect and control AMR in laboratories and clinical institutions. 11 ML is designed to predict outcome variables using an algorithm to enable "machines" to learn the "rules" from the data. 12–14 The parameters of the models are fir -Abstract Truncated-
pharmacology & pharmacy,infectious diseases