Abstract:Background: Diagnostic decision making, especially in emergency departments, is a highly complex cognitive process that involves uncertainty and susceptibility to errors. A combination of factors, including patient factors (eg, history, behaviors, complexity, and comorbidity), provider-care team factors (eg, cognitive load and information gathering and synthesis), and system factors (eg, health information technology, crowding, shift-based work, and interruptions) may contribute to diagnostic errors. Using electronic triggers to identify records of patients with certain patterns of care, such as escalation of care, has been useful to screen for diagnostic errors. Once errors are identified, sophisticated data analytics and machine learning techniques can be applied to existing electronic health record (EHR) data sets to shed light on potential risk factors influencing diagnostic decision making. Objective: This study aims to identify variables associated with diagnostic errors in emergency departments using large-scale EHR data and machine learning techniques. Methods: This study plans to use trigger algorithms within EHR data repositories to generate a large data set of records that are labeled trigger-positive or trigger-negative, depending on whether they meet certain criteria. Samples from both data sets will be validated using medical record reviews, upon which we expect to find a higher number of diagnostic safety events in the trigger-positive subset. Machine learning will be used to evaluate relationships between certain patient factors, provider-care team factors, and system-level risk factors and diagnostic safety signals in the statistically matched groups of trigger-positive and trigger-negative charts. Results: This federally funded study was approved by the institutional review board of 2 academic medical centers with affiliated community hospitals. Trigger queries are being developed at both organizations, and sample cohorts will be labeled using the triggers. Machine learning techniques such as association rule mining, chi-square automated interaction detection, and classification and regression trees will be used to discover important variables that could be incorporated within future clinical decision support systems to help identify and reduce risks that contribute to diagnostic errors. Conclusions: The use of large EHR data sets and machine learning to investigate risk factors (related to the patient, provider-care team, and system-level) in the diagnostic process may help create future mechanisms for monitoring diagnostic safety. International registered report identifier (irrid): DERR1-10.2196/24642.

Research and applications: Phenotyping for patient safety: algorithm development for electronic health record based automated adverse event and medical error detection in …

Developing EMR-based algorithms to Identify hospital adverse events for health system performance evaluation and improvement: Study protocol

Monitoring Diagnostic Safety Risks in Emergency Departments: Protocol for a Machine Learning Study

A Computational Method to Quantitatively Measure Pediatric Drug Safety Using Electronic Medical Records

Evaluation of a Natural Language Processing Approach to Identify Diagnostic Errors and Analysis of Safety Learning System Case Review Data: Retrospective Cohort Study

Machine learning-based risk prediction model for medication administration errors in neonatal intensive care units: A prospective direct observational study

Development and Validation of a Deep Learning Model for Detection of Allergic Reactions Using Safety Event Reports Across Hospitals

Automated Medical Records Review for Mild Cognitive Impairment and Dementia

Leveraging Food and Drug Administration Adverse Event Reports for the Automated Monitoring of Electronic Health Records in a Pediatric Hospital.

Scalable incident detection via natural language processing and probabilistic language models

Accurately identifying incident cases of venous thromboembolism in the electronic health record: Performance of a novel phenotyping algorithm

Vital sign‐based detection of sepsis in neonates using machine learning

Development of an automated phenotyping algorithm for hepatorenal syndrome

Using Electronic Health Records to Identify Asthma-Related Acute Care Encounters

Prevalence, Causes and Severity of Medication Administration Errors in the Neonatal Intensive Care Unit: A Systematic Review and Meta-Analysis

Automating a Manual Sepsis Screening Tool in a Pediatric Emergency Department

Electronic surveillance of patient safety events using natural language processing

Validation of a natural language processing algorithm using national reporting data to improve identification of anesthesia-related ADVerse evENTs: The "ADVENTURE" study

Development and Evaluation of a Natural Language Processing Annotation Tool to Facilitate Phenotyping of Cognitive Status in Electronic Health Records: Diagnostic Study

Developing A Deep Learning Natural Language Processing Algorithm For Automated Reporting Of Adverse Drug Reactions

Patterns of Safety Incidents in a Neonatal Intensive Care Unit