Abstract:BACKGROUND: Surgical patients are complex, vulnerable, and prone to postoperative complications that can potentially be mitigated with quality perioperative risk assessment and management. Several institutions have incorporated machine learning (ML) into their patient care to improve awareness and support clinician decision-making along the perioperative spectrum. Recent research suggests that ML risk prediction can support perioperative patient risk monitoring and management across several situations, including the operating room (OR) to intensive care unit (ICU) handoffs.OBJECTIVES: Our study objectives were threefold: (1) evaluate whether ML-generated postoperative predictions are concordant with clinician-generated risk rankings for acute kidney injury, delirium, pneumonia, deep vein thrombosis, and pulmonary embolism, and establish their associated risk factors; (2) ascertain clinician end-user suggestions to improve adoption of ML-generated risks and their integration into the perioperative workflow; and (3) develop a user-friendly visualization format for a tool to display ML-generated risks and risk factors to support postoperative care planning, for example, within the context of OR-ICU handoffs.METHODS: Graphical user interfaces for postoperative risk prediction models were assessed for end-user usability through cognitive walkthroughs and interviews with anesthesiologists, surgeons, certified registered nurse anesthetists, registered nurses, and critical care physicians. Thematic analysis relying on an explanation design framework was used to identify feedback and suggestions for improvement.RESULTS: 17 clinicians participated in the evaluation. ML estimates of complication risks aligned with clinicians' independent rankings, and related displays were perceived as valuable for decision-making and care planning for postoperative care. During OR-ICU handoffs, the tool could speed up report preparation and remind clinicians to address patient-specific complications, thus providing more tailored care information. Suggestions for improvement centered on electronic tool delivery; methods to build trust in ML models; modifiable risks and risk mitigation strategies; and additional patient information based on individual preferences (e.g., surgical procedure).CONCLUSIONS: ML estimates of postoperative complication risks can provide anticipatory guidance, potentially increasing the efficiency of care planning. We have offered an ML visualization framework for designing future ML-augmented tools and anticipate the development of tools that recommend specific actions to the user based on ML model output.

Early-Warning of Peri-operative Critical Event Based on Multimodal Information Fusion

Multimodal risk prediction with physiological signals, medical images and clinical notes

Early recognition of risk of critical adverse events based on deep neural decision gradient boosting

Deep Learning Model and Multi-Modal Late Fusion For Predicting Adverse Events Following Cardiothoracic Surgery in the ICU Using STS Data and Time Series Intraoperative Data

Multimodal fusion models for pulmonary embolism mortality prediction

Early Prediction of Mortality in Critical Care Setting in Sepsis Patients Using Structured Features and Unstructured Clinical Notes

Learning-Based Multimodal Information Fusion and Behavior Recognition of Vascular Interventionists' Operating Skills

Self-Supervised Predictive Coding with Multimodal Fusion for Patient Deterioration Prediction in Fine-grained Time Resolution

Research on Multimodal Fusion of Temporal Electronic Medical Records

Multimodal fusion network for ICU patient outcome prediction

Prediction of In-Hospital Cardiac Arrest in the Intensive Care Unit: Machine Learning-Based Multimodal Approach

PE-MVCNet: Multi-view and Cross-modal Fusion Network for Pulmonary Embolism Prediction

Intelligent Perioperative System: Towards Real-time Big Data Analytics in Surgery Risk Assessment

Multimode Data Fusion Based Remote Healthcare Framework

Integrating machine learning predictions for perioperative risk management: Towards an empirical design of a flexible-standardized risk assessment tool

Fusion of fully integrated analog machine learning classifier with electronic medical records for real-time prediction of sepsis onset

Early Warning Models Using Machine Learning to Predict Sepsis-Associated Chronic Critical Illness: A Study Based on the Medical Information Mart for Intensive Care Database

Sepsis prediction via the clinical data integration system in the ICU

EventScore: An Automated Real-time Early Warning Score for Clinical Events

Early prediction of circulatory failure in the intensive care unit using machine learning

Machine Learning with Clinical and Intraoperative Biosignal Data for Predicting Cardiac Surgery-Associated Acute Kidney Injury