Abstract:Background Modern clinical care in intensive care units is full of rich data, and machine learning has great potential to support clinical decision-making. The development of intelligent machine learning–based clinical decision support systems is facing great opportunities and challenges. Clinical decision support systems may directly help clinicians accurately diagnose, predict outcomes, identify risk events, or decide treatments at the point of care. Objective We aimed to review the research and application of machine learning–enabled clinical decision support studies in intensive care units to help clinicians, researchers, developers, and policy makers better understand the advantages and limitations of machine learning–supported diagnosis, outcome prediction, risk event identification, and intensive care unit point-of-care recommendations. Methods We searched papers published in the PubMed database between January 1980 and October 2020. We defined selection criteria to identify papers that focused on machine learning–enabled clinical decision support studies in intensive care units and reviewed the following aspects: research topics, study cohorts, machine learning models, analysis variables, and evaluation metrics. Results A total of 643 papers were collected, and using our selection criteria, 97 studies were found. Studies were categorized into 4 topics—monitoring, detection, and diagnosis (13/97, 13.4%), early identification of clinical events (32/97, 33.0%), outcome prediction and prognosis assessment (46/97, 47.6%), and treatment decision (6/97, 6.2%). Of the 97 papers, 82 (84.5%) studies used data from adult patients, 9 (9.3%) studies used data from pediatric patients, and 6 (6.2%) studies used data from neonates. We found that 65 (67.0%) studies used data from a single center, and 32 (33.0%) studies used a multicenter data set; 88 (90.7%) studies used supervised learning, 3 (3.1%) studies used unsupervised learning, and 6 (6.2%) studies used reinforcement learning. Clinical variable categories, starting with the most frequently used, were demographic (n=74), laboratory values (n=59), vital signs (n=55), scores (n=48), ventilation parameters (n=43), comorbidities (n=27), medications (n=18), outcome (n=14), fluid balance (n=13), nonmedicine therapy (n=10), symptoms (n=7), and medical history (n=4). The most frequently adopted evaluation metrics for clinical data modeling studies included area under the receiver operating characteristic curve (n=61), sensitivity (n=51), specificity (n=41), accuracy (n=29), and positive predictive value (n=23). Conclusions Early identification of clinical and outcome prediction and prognosis assessment contributed to approximately 80% of studies included in this review. Using new algorithms to solve intensive care unit clinical problems by developing reinforcement learning, active learning, and time-series analysis methods for clinical decision support will be greater development prospects in the future.

Moving From In Silico to In Clinico Evaluations of Machine Learning-Based Interventions in Critical Care*

State of the Art of Machine Learning–Enabled Clinical Decision Support in Intensive Care Units: Literature Review

Artificial Intelligence and Machine Learning Applications in Critically Ill Brain Injured Patients

Machine Learning for Benchmarking Critical Care Outcomes

The use of machine learning and artificial intelligence within pediatric critical care

Tell me something interesting: Clinical utility of machine learning prediction models in the ICU

Is artificial intelligence prepared for the 24-h shifts in the ICU?

Application of Machine Learning Models to Biomedical and Information System Signals From Critically Ill Adults

Use of artificial intelligence in critical care: opportunities and obstacles

Clinical evaluation of a machine learning-based early warning system for patient deterioration

Automating Construction of Machine Learning Models With Clinical Big Data: Proposal Rationale and Methods

Low Responsiveness of Machine Learning Models to Critical or Deteriorating Health Conditions

Strategies for Implementing Machine Learning Algorithms in the Clinical Practice of Radiology

Evaluating Physician-AI Interaction for Cancer Management: Paving the Path towards Precision Oncology

Implementing Machine Learning in Interventional Cardiology: The Benefits Are Worth the Trouble

Using machine learning in prediction of ICU admission, mortality, and length of stay in the early stage of admission of COVID-19 patients

Machine learning in healthcare -- a system's perspective

Evaluating Machine Learning Models against Clinical Protocols for Enhanced Interpretability and Continuity of Care

ICU Patients’ Pattern Recognition and Correlation Identification of Vital Parameters Using Optimized Machine Learning Models

The Impact of Information Relevancy and Interactivity on Intensivists' Trust in a Machine Learning-Based Bacteremia Prediction System: Simulation Study

From patterns to patients: Advances in clinical machine learning for cancer diagnosis, prognosis, and treatment