Is Artificial Intelligence Ready to Take Over Triage?

Katie M. Lebold,Carl Preiksaitis

DOI: https://doi.org/10.1016/j.annemergmed.2024.03.011

IF: 6.762

2024-04-20

Annals of Emergency Medicine

Abstract:Nasser L, McLeod SL, Hall JN. Evaluating the reliability of a remote acuity prediction tool in a Canadian Academic Emergency Department. Ann Emerg Med . 2024:S0196-0644(23)01387-2.

emergency medicine

What problem does this paper attempt to address?

Evaluating the Reliability of a Remote Acuity Prediction Tool in a Canadian Academic Emergency Department

Laila Nasser,Shelley L. McLeod,Justin N. Hall

DOI: https://doi.org/10.1016/j.annemergmed.2023.11.018

IF: 6.762

2024-01-05

Annals of Emergency Medicine

Abstract:Study objective There is increasing interest in harnessing artificial intelligence to virtually triage patients seeking care. The objective was to examine the reliability of a virtual machine learning algorithm to remotely predict acuity scores for patients seeking emergency department (ED) care by applying the algorithm to retrospective ED data. Methods This was a retrospective review of adult patients conducted at an academic tertiary care ED (annual census 65,000) from January 2021 to August 2022. Data including ED visit date and time, patient age, sex, reason for visit, presenting complaint and patient-reported pain score were used by the machine learning algorithm to predict acuity scores. The algorithm was designed to up-triage high-risk complaints to promote safety for remote use. The predicted scores were then compared to nurse-led triage scores previously derived in real time using the electronic Canadian Triage and Acuity Scale (eCTAS), an electronic triage decision-support tool used in the ED. Interrater reliability was estimated using kappa statistics with 95% confidence intervals (CIs). Results In total, 21,469 unique ED patient encounters were included. Exact modal agreement was achieved for 10,396 (48.4%) patient encounters. Interrater reliability ranged from poor to fair, as estimated using unweighted kappa (0.18, 95% CI 0.17 to 0.19), linear-weighted kappa (0.25, 95% CI 0.24 to 0.26), and quadratic-weighted kappa (0.36, 95% CI 0.35 to 0.37) statistics. Using the nurse-led eCTAS score as the reference, the machine learning algorithm overtriaged 9,897 (46.1%) and undertriaged 1,176 (5.5%) cases. Some of the presenting complaints under-triaged were conditions generally requiring further probing to delineate their nature, including abnormal lab/imaging results, visual disturbance, and fever. Conclusion This machine learning algorithm needs further refinement before being safely implemented for patient use.

emergency medicine
ARTIFICIAL INTELLIGENCE IN PATIENT TRIAGE: A COMPREHENSIVE LITERATURE REVIEW IN EMERGENCY DEPARTMENTS

Ajit Baviskar,Deepali Rajpal,Arsh Sharma,Anam Imtiyaz Hajir

DOI: https://doi.org/10.36106/ijsr/4802794

2023-12-01

International Journal of Scientific Research

Abstract:In the ever-evolving landscape of healthcare, the integration of Articial Intelligence (AI) has emerged as a ground breaking force, particularly in the realm of patient triage within Emergency Departments (EDs). The urgency and complexity inherent in emergency healthcare demand swift and precise decision-making processes. With the potential to revolutionize the way patients are prioritized and cared for, AI technologies, including machine learning and natural language processing, have become pivotal tools in enhancing the efciency and effectiveness of the critical triage process. This comprehensive literature review explores the multifaceted applications, outcomes, challenges, and future prospects of AI in patient triage within Emergency Departments. By delving into a myriad of studies and research endeavours, this review aims to provide a holistic understanding of how AI is reshaping the landscape of emergency healthcare, offering new avenues for improved patient outcomes and optimized resource utilization. From predictive triage models to natural language processing applications and image analysis, the examination of diverse AI approaches promises to shed light on the transformative potential and evolving role of AI in the crucial domain of patient triage. As we embark on this exploration, it becomes evident that the amalgamation of AI and emergency healthcare holds the key to a more efcient, accurate, and responsive patient triage system, ultimately shaping the future of emergency medical practice.
Support Systems of Clinical Decisions in the Triage of the Emergency Department Using Artificial Intelligence: The Efficiency to Support Triage

Eleni Karlafti,Athanasios Anagnostis,Theodora Simou,Angeliki Sevasti Kollatou,Daniel Paramythiotis,Georgia Kaiafa,Triantafyllos Didaggelos,Christos Savvopoulos,Varvara Fyntanidou

DOI: https://doi.org/10.15388/Amed.2023.30.1.2

Abstract:Purpose: In the Emergency Departments (ED) the current triage systems that are been implemented are based completely on medical education and the perception of each health professional who is in charge. On the other hand, cutting-edge technology, Artificial Intelligence (AI) can be incorporated into healthcare systems, supporting the healthcare professionals' decisions, and augmenting the performance of triage systems. The aim of the study is to investigate the efficiency of AI to support triage in ED. Patients–methods: The study included 332 patients from whom 23 different variables related to their condition were collected. From the processing of patient data for input variables, it emerged that the average age was 56.4 ± 21.1 years and 50.6% were male. The waiting time had an average of 59.7 ± 56.3 minutes while 3.9% ± 0.1% entered the Intensive Care Unit (ICU). In addition, qualitative variables related to the patient's history and admission clinics were used. As target variables were taken the days of stay in the hospital, which were on average 1.8 ± 5.9, and the Emergency Severity Index (ESI) for which the following distribution applies: ESI: 1, patients: 2; ESI: 2, patients: 18; ESI: 3, patients: 197; ESI: 4, patients: 73; ESI: 5, patients: 42. Results: To create an automatic patient screening classifier, a neural network was developed, which was trained based on the data, so that it could predict each patient's ESI based on input variables.The classifier achieved an overall accuracy (F1 score) of 72.2% even though there was an imbalance in the classes. Conclusions: The creation and implementation of an AI model for the automatic prediction of ESI, highlighted the possibility of systems capable of supporting healthcare professionals in the decision-making process. The accuracy of the classifier has not reached satisfactory levels of certainty, however, the performance of similar models can increase sharply with the collection of more data.
The effects of applying artificial intelligence to triage in the emergency department: A systematic review of prospective studies

Nayeon Yi,Dain Baik,Gumhee Baek

DOI: https://doi.org/10.1111/jnu.13024

2024-09-13

Journal of Nursing Scholarship

Abstract:Introduction Accurate and rapid triage can reduce undertriage and overtriage, which may improve emergency department flow. This study aimed to identify the effects of a prospective study applying artificial intelligence‐based triage in the clinical field. Design Systematic review of prospective studies. Methods CINAHL, Cochrane, Embase, PubMed, ProQuest, KISS, and RISS were searched from March 9 to April 18, 2023. All the data were screened independently by three researchers. The review included prospective studies that measured outcomes related to AI‐based triage. Three researchers extracted data and independently assessed the study's quality using the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) protocol. Results Of 1633 studies, seven met the inclusion criteria for this review. Most studies applied machine learning to triage, and only one was based on fuzzy logic. All studies, except one, utilized a five‐level triage classification system. Regarding model performance, the feed‐forward neural network achieved a precision of 33% in the level 1 classification, whereas the fuzzy clip model achieved a specificity and sensitivity of 99%. The accuracy of the model's triage prediction ranged from 80.5% to 99.1%. Other outcomes included time reduction, overtriage and undertriage checks, mistriage factors, and patient care and prognosis outcomes. Conclusion Triage nurses in the emergency department can use artificial intelligence as a supportive means for triage. Ultimately, we hope to be a resource that can reduce undertriage and positively affect patient health. Protocol Registration We have registered our review in PROSPERO (registration number: CRD 42023415232).

nursing
Improving Emergency Department ESI Acuity Assignment Using Machine Learning and Clinical Natural Language Processing

Oleksandr Ivanov,Lisa Wolf,Deena Brecher,Kevin Masek,Erica Lewis,Stephen Liu,Robert B Dunne,Kevin Klauer,Kyla Montgomery,Yurii Andrieiev,Moss McLaughlin,Christian Reilly

DOI: https://doi.org/10.48550/arXiv.2004.05184

2020-03-29

Computers and Society

Abstract:Effective triage is critical to mitigating the effect of increased volume by accurately determining patient acuity, need for resources, and establishing effective acuity-based patient prioritization. The purpose of this retrospective study was to determine whether historical EHR data can be extracted and synthesized with clinical natural language processing (C-NLP) and the latest ML algorithms (KATE) to produce highly accurate ESI predictive models. An ML model (KATE) for the triage process was developed using 166,175 patient encounters from two participating hospitals. The model was then tested against a gold set that was derived from a random sample of triage encounters at the study sites and correct acuity assignments were recorded by study clinicians using the Emergency Severity Index (ESI) standard as a guide. At the two study sites, KATE predicted accurate ESI acuity assignments 75.9% of the time, compared to nurses (59.8%) and average individual study clinicians (75.3%). KATE accuracy was 26.9% higher than the average nurse accuracy (p-value < 0.0001). On the boundary between ESI 2 and ESI 3 acuity assignments, which relates to the risk of decompensation, KATE was 93.2% higher with 80% accuracy, compared to triage nurses with 41.4% accuracy (p-value < 0.0001). KATE provides a triage acuity assignment substantially more accurate than the triage nurses in this study sample. KATE operates independently of contextual factors, unaffected by the external pressures that can cause under triage and may mitigate the racial and social biases that can negatively affect the accuracy of triage assignment. Future research should focus on the impact of KATE providing feedback to triage nurses in real time, KATEs impact on mortality and morbidity, ED throughput, resource optimization, and nursing outcomes.
Prospective Evaluation of Artificial Intelligence Triage of Intracranial Hemorrhage on Noncontrast Head CT Examinations

Cody H Savage,Manoj Tanwar,Asser Abou Elkassem,Adam Sturdivant,Omar Hamki,Houman Sotoudeh,Gopi Sirineni,Aparna Singhal,Desmin Milner,Jesse Jones,Dirk Rehder,Mei Li,Yufeng Li,Kevin Junck,Srini Tridandapani,Steven A Rothenberg,Andrew D Smith

DOI: https://doi.org/10.2214/AJR.24.31639

2024-09-04

Abstract:Background: Retrospective studies evaluating artificial intelligence (AI) algorithms for intracranial hemorrhage (ICH) detection on noncontrast CT (NCCT) have shown promising results but lack prospective validation. Objective: To evaluate the impact on radiologists' real-world aggregate performance for ICH detection and report turnaround times for ICH-positive examinations of a radiology department's implementation of an AI triage and notification system for ICH detection on head NCCT examinations. Methods: This prospective single-center study included adult patients who underwent head NCCT examinations from May 12, 2021 to June 30, 2021 (phase 1) or September 30, 2021 to December 4, 2021 (phase 2). Before phase 1, the radiology department implemented a commercial AI triage system for ICH detection that processed head NCCT examinations and notified radiologists of positive results through a widget with a floating pop-up display. Examinations were interpreted by neuroradiologists or emergency radiologists, who evaluated examinations without and with AI assistance in phase 1 and phase 2, respectively. A panel of radiologists conducted a review process for all examinations with discordance between the radiology report and AI and a subset of remaining examinations, to establish the reference standard. Diagnostic performance and report turnaround times were compared using Pearson chi-square test and Wilcoxon rank-sum test, respectively. Bonferroni correction was used to account for five diagnostic performance metrics (adjusted significance threshold, .01 [α=.05/5]). Results: A total of 9954 examinations from 7371 patients (mean age, 54.8±19.8 years; 3773 female, 3598 male) were included. In phases 1 and 2, 19.8% (735/3716) and 21.9% (1368/6238) of examinations, respectively, were positive for ICH (P=.01). Radiologists without versus with AI showed no significant difference in accuracy (99.5% vs 99.2%), sensitivity (98.6% vs 98.9%), PPV (99.0% vs 99.7%), or NPV (99.7% vs 99.7%) (all P>.01); specificity was higher for radiologists without than with AI (99.8% vs 99.3%, respectively, P=.004). Mean report turnaround time for ICH-positive examinations was 147.1 minutes without AI versus 149.9 minutes with AI (P=.11). Conclusion: An AI triage system for ICH detection did not improve radiologists' diagnostic performance or report turnaround times. Clinical Impact: This large prospective real-world study does not support use of AI assistance for ICH detection.
Implementing Triage-Bot: Supporting the Current Practice for Triage Nurses

Kim Sears,Sam Belbin,Elyas Rashno,Drishti Sharma,Kevin Woo,Farhana Zulkernine,Ciprian Daniel Neagu,Bita Amani,Furkan Alaca

2024-08-16

Abstract:In Canada, emergency departments (ED) have 15.1 million unscheduled visits every year; this has been suggested to indicate that patients rely on ED to address the gaps experienced by 6.5 million Canadians who lack a primary care provider. When this large number of visits is coupled with a predicted shortage of 100,000 nurses in Canada by 2030, ED can be expected to face resource limitations, which highlights the importance of triage systems as a source of immediate support. Technology that incorporates innovative analytical methods, automation of routine, and efficient processing can be leveraged to enhance patient outcomes, streamline clinical processes, and improve the overall quality and efficiency of healthcare delivery. This paper aims to highlight how the Triage-Bot, a proposed AI system, can assist ED nurses when triaging patients. The Triage-Bot system is based on the Canadian Triage and Acuity Scale (CTAS), which currently serves as a standardized and highly effective tool for prioritizing patient care in emergency departments across the country. Pre-set and open-ended questions are asked using voice and video, allowing patients to describe their health concerns and conditions. Triage-Bot automatically measures the following vital signs: heart rate (HR), heart rate variability (HRV), oxygen saturation (SpO2), respiratory rate (RR), blood pressure (BP), blood glucose (BG), and stress. The system uses artificial intelligence models, particularly those with a deep learning approach that simultaneously analyzes both the user's facial expression and voice tone. Implementation: A systematic review addressed the implications of AI in nursing and concluded that it could contribute to patient care by providing personalized instructions and/or remotely monitoring patients. The Triage-Bot system can be implemented in healthcare facilities, such as emergency department waiting rooms. The information it collects can then be added to a patient's health records to support nurses in assessing the severity of each patient's condition. Limitations: If the system is accessed without a nurse's guidance, it is imperative that the user receives information regarding when to visit a healthcare provider or ED. Continuous improvements in Triage-Bot's accessibility for patients with varying abilities are required to ensure that the system remains user-friendly during times of illness. The voice and text interaction can also be influenced by a user's understanding of language, culture, and age-related factors.
Artificial intelligence in emergency medicine: A scoping review

Abirami Kirubarajan,Ahmed Taher,Shawn Khan,Sameer Masood

DOI: https://doi.org/10.1002/emp2.12277

2020-11-07

Abstract:Introduction: Despite the growing investment in and adoption of artificial intelligence (AI) in medicine, the applications of AI in an emergency setting remain unclear. This scoping review seeks to identify available literature regarding the applications of AI in emergency medicine. Methods: The scoping review was conducted according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for scoping reviews using Medline-OVID, EMBASE, CINAHL, and IEEE, with a double screening and extraction process. The search included articles published until February 28, 2020. Articles were excluded if they did not self-classify as studying an AI intervention, were not relevant to the emergency department (ED), or did not report outcomes or evaluation. Results: Of the 1483 original database citations, 395 were eligible for full-text evaluation. Of these articles, a total of 150 were included in the scoping review. The majority of included studies were retrospective in nature (n = 124, 82.7%), with only 3 (2.0%) prospective controlled trials. We found 37 (24.7%) interventions aimed at improving diagnosis within the ED. Among the 150 studies, 19 (12.7%) focused on diagnostic imaging within the ED. A total of 16 (10.7%) studies were conducted in the out-of-hospital environment (eg, emergency medical services, paramedics) with the remainder occurring either in the ED or the trauma bay. Of the 24 (16%) studies that had human comparators, there were 12 (8%) studies in which AI interventions outperformed clinicians in at least 1 measured outcome. Conclusion: AI-related research is rapidly increasing in emergency medicine. There are several promising AI interventions that can improve emergency care, particularly for acute radiographic imaging and prediction-based diagnoses. Higher quality evidence is needed to further assess both short- and long-term clinical outcomes.
Attitudes towards artificial intelligence in emergency medicine

Jonathon Stewart,Samuel Freeman,Ege Eroglu,Nicole Dumitrascu,Juan Lu,Adrian Goudie,Peter Sprivulis,Hamed Akhlaghi,Viet Tran,Frank Sanfilippo,Antonio Celenza,Martin Than,Daniel Fatovich,Katie Walker,Girish Dwivedi

DOI: https://doi.org/10.1111/1742-6723.14345

Abstract:Objective: To assess Australian and New Zealand emergency clinicians' attitudes towards the use of artificial intelligence (AI) in emergency medicine. Methods: We undertook a qualitative interview-based study based on grounded theory. Participants were recruited through ED internal mailing lists, the Australasian College for Emergency Medicine Bulletin, and the research teams' personal networks. Interviews were transcribed, coded and themes presented. Results: Twenty-five interviews were conducted between July 2021 and May 2022. Thematic saturation was achieved after 22 interviews. Most participants were from either Western Australia (52%) or Victoria (16%) and were consultants (96%). More participants reported feeling optimistic (10/25) than neutral (6/25), pessimistic (2/25) or mixed (7/25) towards the use of AI in the ED. A minority expressed scepticism regarding the feasibility or value of implementing AI into the ED. Multiple potential risks and ethical issues were discussed by participants including skill loss from overreliance on AI, algorithmic bias, patient privacy and concerns over liability. Participants also discussed perceived inadequacies in existing information technology systems. Participants felt that AI technologies would be used as decision support tools and not replace the roles of emergency clinicians. Participants were not concerned about the impact of AI on their job security. Most (17/25) participants thought that AI would impact emergency medicine within the next 10 years. Conclusions: Emergency clinicians interviewed were generally optimistic about the use of AI in emergency medicine, so long as it is used as a decision support tool and they maintain the ability to override its recommendations.
Desired Clinical Applications of Artificial Intelligence in Emergency Medicine: An International e-Delphi Study

Henry Li,Jake Hayward,Leandro Solis Aguilar,Jeffrey Michael Franc

DOI: https://doi.org/10.1017/dmp.2024.195

IF: 5.556

2024-11-01

Disaster Medicine and Public Health Preparedness

Abstract:Objective Artificial intelligence (AI) in emergency medicine has been increasingly studied over the past decade. However, the implementation of AI requires significant buy-in from end-users. This study explored desired clinical applications of AI by emergency physicians. Methods A 3-round Delphi process was undertaken using STAT59 software. An international expert panel was assembled through purposeful sampling to reflect a diversity in geography, age, time in practice, practice setting, role, and expertise. Items generated in Round 1 were collated by the study team and ranked in Rounds 2 and 3 on a 7-point linear numeric scale of importance. Consensus was defined as a standard deviation of 1.0 or less. Results Of 66 invited experts, 29 completed Round 1, 25 completed Round 2, and 23 completed Round 3. Three statements reached consensus in Round 2 and four statements reached consensus in Round 3, including safe prescribing, guiding choice of drug, adjusting drug doses, identifying risk or prognosis, and reporting/interpreting investigation results. Conclusions Many desired clinical applications of AI in emergency medicine have not yet been explored. Clinical and technological experts should co-create new applications to ensure buy-in from all stakeholders. Specialty organizations can lead the way by establishing local clinical priorities.

public, environmental & occupational health
Artificial Intelligence Decision Support for Medical Triage

Chiara Marchiori,Douglas Dykeman,Ivan Girardi,Adam Ivankay,Kevin Thandiackal,Mario Zusag,Andrea Giovannini,Daniel Karpati,Henri Saenz

DOI: https://doi.org/10.48550/arXiv.2011.04548

IF: 14.4

2020-11-09

Artificial Intelligence

Abstract:Applying state-of-the-art machine learning and natural language processing on approximately one million of teleconsultation records, we developed a triage system, now certified and in use at the largest European telemedicine provider. The system evaluates care alternatives through interactions with patients via a mobile application. Reasoning on an initial set of provided symptoms, the triage application generates AI-powered, personalized questions to better characterize the problem and recommends the most appropriate point of care and time frame for a consultation. The underlying technology was developed to meet the needs for performance, transparency, user acceptance and ease of use, central aspects to the adoption of AI-based decision support systems. Providing such remote guidance at the beginning of the chain of care has significant potential for improving cost efficiency, patient experience and outcomes. Being remote, always available and highly scalable, this service is fundamental in high demand situations, such as the current COVID-19 outbreak.
Artificial Intelligence in Emergency Medicine: A Case for More

Nupur Garg

DOI: https://doi.org/10.1016/j.annemergmed.2024.04.007

IF: 6.762

2024-05-25

Annals of Emergency Medicine

Abstract:Clinician decisions are subject to human error, which can increase with the physical, cognitive, and emotional burdens commonplace in emergency departments (EDs). 7 One long-standing solution is to decrease the number of ad hoc decisions through the use of clinical decision support systems. 8 In the taxing environment of the ED, decreasing one's cognitive load through clinical decision support systems measurably reduces human error. 8 , 9 For example, clinical decision support systems can be

emergency medicine
Assessing the precision of artificial intelligence in emergency department triage decisions: Insights from a study with ChatGPT

Sinan Paslı,Abdul Samet Şahin,Muhammet Fatih Beşer,Hazal Topçuoğlu,Metin Yadigaroğlu,Melih İmamoğlu

DOI: https://doi.org/10.1016/j.ajem.2024.01.037

IF: 3.6

2024-01-26

The American Journal of Emergency Medicine

Abstract:Background The rise in emergency department presentations globally poses challenges for efficient patient management. To address this, various strategies aim to expedite patient management. Artificial intelligence's (AI) consistent performance and rapid data interpretation extend its healthcare applications, especially in emergencies. The introduction of a robust AI tool like ChatGPT, based on GPT-4 developed by OpenAI, can benefit patients and healthcare professionals by improving the speed and accuracy of resource allocation. This study examines ChatGPT's capability to predict triage outcomes based on local emergency department rules. Methods This study is a single-center prospective observational study. The study population consists of all patients who presented to the emergency department with any symptoms and agreed to participate. The study was conducted on three non-consecutive days for a total of 72 h. Patients' chief complaints, vital parameters, medical history and the area to which they were directed by the triage team in the emergency department were recorded. Concurrently, an emergency medicine physician inputted the same data into previously trained GPT-4, according to local rules. According to this data, the triage decisions made by GPT-4 were recorded. In the same process, an emergency medicine specialist determined where the patient should be directed based on the data collected, and this decision was considered the gold standard. Accuracy rates and reliability for directing patients to specific areas by the triage team and GPT-4 were evaluated using Cohen's kappa test. Furthermore, the accuracy of the patient triage process performed by the triage team and GPT-4 was assessed by receiver operating characteristic (ROC) analysis. Statistical analysis considered a value of p < 0.05 as significant. Results The study was carried out on 758 patients. Among the participants, 416 (54.9%) were male and 342 (45.1%) were female. Evaluating the primary endpoints of our study - the agreement between the decisions of the triage team, GPT-4 decisions in emergency department triage, and the gold standard - we observed almost perfect agreement both between the triage team and the gold standard and between GPT-4 and the gold standard (Cohen's Kappa 0.893 and 0.899, respectively; p < 0.001 for each). Conclusion Our findings suggest GPT-4 possess outstanding predictive skills in triaging patients in an emergency setting. GPT-4 can serve as an effective tool to support the triage process.

emergency medicine
Implementation considerations for the adoption of artificial intelligence in the emergency department

R. Cheng,A. Aggarwal,A. Chakraborty,V. Harish,M. McGowan,A. Roy,A. Szulewski,B. Nolan

DOI: https://doi.org/10.1016/j.ajem.2024.05.020

IF: 3.6

2024-05-26

The American Journal of Emergency Medicine

Abstract:Objective Artificial intelligence (AI) has emerged as a potentially transformative force, particularly in the realm of emergency medicine (EM). The implementation of AI in emergency departments (ED) has the potential to improve patient care through various modalities. However, the implementation of AI in the ED presents unique challenges that influence its clinical adoption. This scoping review summarizes the current literature exploring the barriers and facilitators of the clinical implementation of AI in the ED. Methods We systematically searched Embase (Ovid), MEDLINE (Ovid), Web of Science, and Engineering Village. All articles were published in English through November 20th, 2023. Two reviewers screened the search results, with disagreements resolved through third-party adjudication. Results A total of 8172 studies were included in the preliminary search, with 22 selected for the final data extraction. 10 studies were reviews and the remaining 12 were primary quantitative, qualitative, and mixed-methods studies. Out of the 22, 13 studies investigated a specific AI tool or application. Common barriers to implementation included a lack of model interpretability and explainability, encroachment on physician autonomy, and medicolegal considerations. Common facilitators to implementation included educating staff on the model, efficient integration into existing workflows, and sound external validation. Conclusion There is increasing literature on AI implementation in the ED. Our research suggests that the most common barrier facing AI implementation in the ED is model interpretability and explainability. More primary research investigating the implementation of specific AI tools should be undertaken to help facilitate their successful clinical adoption in the ED.

emergency medicine
Artificial intelligence in emergency radiology: A review of applications and possibilities

Benjamin D Katzman,Christian B van der Pol,Philippe Soyer,Michael N Patlas,Benjamin D. Katzman,Christian B. van der Pol,Michael N. Patlas

DOI: https://doi.org/10.1016/j.diii.2022.07.005

IF: 7.242

2022-08-05

Diagnostic and Interventional Imaging

Abstract:Artificial intelligence (AI) applications in radiology have been rising exponentially in the last decade. Although AI has found usage in various areas of healthcare, its utilization in the emergency department (ED) as a tool for emergency radiologists shows great promise towards easing some of the challenges faced daily. There have been numerous reported studies examining the application of AI-based algorithms in identifying common ED conditions to ensure more rapid reporting and in turn quicker patient care. In addition to interpretive applications, AI assists with many of the non-interpretive tasks that are encountered every day by emergency radiologists. These include, but are not limited to, protocolling, image quality control and workflow prioritization. AI continues to face challenges such as physician uptake or costs, but is a long-term investment that shows great potential to relieve many difficulties faced by emergency radiologists and ultimately improve patient outcomes. This review sums up the current advances of AI in emergency radiology, including current diagnostic applications (interpretive) and applications that stretch beyond imaging (non-interpretive), analyzes current drawbacks of AI in emergency radiology and discusses future challenges.

radiology, nuclear medicine & medical imaging
The Impact of Cultural Embeddedness on the Implementation of an Artificial Intelligence Program at Triage: A Qualitative Study

Michael Jordan,Jacob Hauser,Stephanie Cota,Hong Li,Lisa Wolf

DOI: https://doi.org/10.1177/10436596221129226

Abstract:Introduction: Triage requires rapid determination of acuity and resources. Current modalities allow for individual judgment, with varied application of algorithmic rules. Although artificial intelligence can improve triage accuracy, gaps remain in understanding implementation facilitators and barriers, especially those related to the cultural understandings by nurses of emergency department presentations. The purpose of this study was to explore the cultural and technological elements of the implementation of an artificial intelligence clinical decision support aid (i.e., KATE) in an emergency nursing triage process in an urban community hospital on the West Coast of the United States. Method: An exploratory qualitative study using semi-structured small group and individual interviews and constant comparison analysis strategies. The sample comprised 13 emergency department triage nurses at one site. Campinha-Bacote's theory of cultural competence framed the study. Results: Responses yielded the overall theme of We know these people and we know these things. Supporting categories included the problem of aire; just another checkbox; gut trumps data; higher acuity with no resources; and technology as a safety net. Participants reported reliance on clinical experience and cultural knowledge to assign acuity. Discussion: The implementation of an artificial intelligence program was initially received skeptically due to the acontextual nature of AI, but grew to be perceived as a safety net for triage decision making among emergency nurses.
Needs and expectations for artificial intelligence in emergency medicine according to Canadian physicians

Kyle W Eastwood,Ronald May,Pantelis Andreou,Samina Abidi,Syed Sibte Raza Abidi,Osama M Loubani

DOI: https://doi.org/10.1186/s12913-023-09740-w

2023-07-25

Abstract:Background: Artificial Intelligence (AI) is recognized by emergency physicians (EPs) as an important technology that will affect clinical practice. Several AI-tools have already been developed to aid care delivery in emergency medicine (EM). However, many EM tools appear to have been developed without a cross-disciplinary needs assessment, making it difficult to understand their broader importance to general-practice. Clinician surveys about AI tools have been conducted within other medical specialties to help guide future design. This study aims to understand the needs of Canadian EPs for the apt use of AI-based tools. Methods: A national cross-sectional, two-stage, mixed-method electronic survey of Canadian EPs was conducted from January-May 2022. The survey includes demographic and physician practice-pattern data, clinicians' current use and perceptions of AI, and individual rankings of which EM work-activities most benefit from AI. Results: The primary outcome is a ranked list of high-priority AI-tools for EM that physicians want translated into general use within the next 10 years. When ranking specific AI examples, 'automated charting/report generation', 'clinical prediction rules' and 'monitoring vitals with early-warning detection' were the top items. When ranking by physician work-activities, 'AI-tools for documentation', 'AI-tools for computer use' and 'AI-tools for triaging patients' were the top items. For secondary outcomes, EPs indicated AI was 'likely' (43.1%) or 'extremely likely' (43.7%) to be able to complete the task of 'documentation' and indicated either 'a-great-deal' (32.8%) or 'quite-a-bit' (39.7%) of potential for AI in EM. Further, EPs were either 'strongly' (48.5%) or 'somewhat' (39.8%) interested in AI for EM. Conclusions: Physician input on the design of AI is essential to ensure the uptake of this technology. Translation of AI-tools to facilitate documentation is considered a high-priority, and respondents had high confidence that AI could facilitate this task. This study will guide future directions regarding the use of AI for EM and help direct efforts to address prevailing technology-translation barriers such as access to high-quality application-specific data and developing reporting guidelines for specific AI-applications. With a prioritized list of high-need AI applications, decision-makers can develop focused strategies to address these larger obstacles.
The potential of virtual triage AI to improve early detection, care acuity alignment, and emergent care referral of life-threatening conditions

George A Gellert,Aleksandra Kabat-Karabon,Gabriel L Gellert,Joanna Rasławska-Socha,Stanislaw Gorski,Tim Price,Kacper Kuszczyński,Natalia Marcjasz,Mateusz Palczewski,Jakub Jaszczak,Irving K Loh,Piotr M Orzechowski

DOI: https://doi.org/10.3389/fpubh.2024.1362246

2024-05-13

Abstract:Objective: To evaluate the extent to which patient-users reporting symptoms of five severe/acute conditions requiring emergency care to an AI-based virtual triage (VT) engine had no intention to get such care, and whose acuity perception was misaligned or decoupled from actual risk of life-threatening symptoms. Methods: A dataset of 3,022,882 VT interviews conducted over 16 months was evaluated to quantify and describe patient-users reporting symptoms of five potentially life-threatening conditions whose pre-triage healthcare intention was other than seeking urgent care, including myocardial infarction, stroke, asthma exacerbation, pneumonia, and pulmonary embolism. Results: Healthcare intent data was obtained for 12,101 VT patient-user interviews. Across all five conditions a weighted mean of 38.5% of individuals whose VT indicated a condition requiring emergency care had no pre-triage intent to consult a physician. Furthermore, 61.5% intending to possibly consult a physician had no intent to seek emergency medical care. After adjustment for 13% VT safety over-triage/referral to ED, a weighted mean of 33.5% of patient-users had no intent to seek professional care, and 53.5% had no intent to seek emergency care. Conclusion: AI-based VT may offer a vehicle for early detection and care acuity alignment of severe evolving pathology by engaging patients who believe their symptoms are not serious, and for accelerating care referral and delivery for life-threatening conditions where patient misunderstanding of risk, or indecision, causes care delay. A next step will be clinical confirmation that when decoupling of patient care intent from emergent care need occurs, VT can influence patient behavior to accelerate care engagement and/or emergency care dispatch and treatment to improve clinical outcomes.
Artificial intelligence to advance acute and intensive care medicine

Laurens A Biesheuvel,Dave A Dongelmans,Paul W G Elbers,Laurens A. Biesheuvel,Dave A. Dongelmans,Paul W.G. Elbers

DOI: https://doi.org/10.1097/mcc.0000000000001150

2024-03-14

Current Opinion in Critical Care

Abstract:Purpose of review This review explores recent key advancements in artificial intelligence for acute and intensive care medicine. As artificial intelligence rapidly evolves, this review aims to elucidate its current applications, future possibilities, and the vital challenges that are associated with its integration into emergency medical dispatch, triage, medical consultation and ICUs. Recent findings The integration of artificial intelligence in emergency medical dispatch (EMD) facilitates swift and accurate assessment. In the emergency department (ED), artificial intelligence driven triage models leverage diverse patient data for improved outcome predictions, surpassing human performance in retrospective studies. Artificial intelligence can streamline medical documentation in the ED and enhances medical imaging interpretation. The introduction of large multimodal generative models showcases the future potential to process varied biomedical data for comprehensive decision support. In the ICU, artificial intelligence applications range from early warning systems to treatment suggestions. Summary Despite promising academic strides, widespread artificial intelligence adoption in acute and critical care is hindered by ethical, legal, technical, organizational, and validation challenges. Despite these obstacles, artificial intelligence's potential to streamline clinical workflows is evident. When these barriers are overcome, future advancements in artificial intelligence have the potential to transform the landscape of patient care for acute and intensive care medicine.

critical care medicine
Novel ways of applying artificial intelligence in emergency medicine - literature review

Jakub Fiegler-Rudol,Magdalena Kronenberg,Tomasz Męcik-Kronenberg

DOI: https://doi.org/10.36740/emems202402109

2024-01-01

Emergency Medical Service

Abstract:Artificial intelligence (AI) holds immense promise for revolutionizing emergency medicine, expediting diagnosis and treatment decisions. This review explores AI’s wide-ranging applications in emergency care, ranging from managing out-of-hospital cardiac arrest (OHCA) to diagnosing fractures, spine injuries, stroke, and pulmonary embolisms, and even assisting in search and rescue missions with snake robots. In OHCA cases, AI aids in early detection, survival prediction, and ECG waveform classification, bolstering prehospital care efficiency. AI-powered digital assistants like the AI4EMS platform optimize diagnosis and patient prioritization, reducing overlooked cases of cardiac arrest and improving response times. Furthermore, AI algorithms enhance the diagnosis of conditions such as pneumothorax, pulmonary emphysema, and fractures by analysing medical images with exceptional accuracy, often outperforming human experts. In stroke and pulmonary embolism, AI expedites diagnosis through automated imaging analysis, enabling swift treatment. AI may enhance triage methods with independent systems, improving patient sharing and treatment quality while minimizing infection risks, especially during pandemics. Medical professionals generally welcome AI triage systems, acknowledging their potential to enhance healthcare efficiency. It is important to understand the scope of development of AI in order to make its application beneficial.

Is Artificial Intelligence Ready to Take Over Triage?

Evaluating the Reliability of a Remote Acuity Prediction Tool in a Canadian Academic Emergency Department

ARTIFICIAL INTELLIGENCE IN PATIENT TRIAGE: A COMPREHENSIVE LITERATURE REVIEW IN EMERGENCY DEPARTMENTS

Support Systems of Clinical Decisions in the Triage of the Emergency Department Using Artificial Intelligence: The Efficiency to Support Triage

The effects of applying artificial intelligence to triage in the emergency department: A systematic review of prospective studies

Improving Emergency Department ESI Acuity Assignment Using Machine Learning and Clinical Natural Language Processing

Prospective Evaluation of Artificial Intelligence Triage of Intracranial Hemorrhage on Noncontrast Head CT Examinations

Implementing Triage-Bot: Supporting the Current Practice for Triage Nurses

Artificial intelligence in emergency medicine: A scoping review

Attitudes towards artificial intelligence in emergency medicine

Desired Clinical Applications of Artificial Intelligence in Emergency Medicine: An International e-Delphi Study

Artificial Intelligence Decision Support for Medical Triage

Artificial Intelligence in Emergency Medicine: A Case for More

Assessing the precision of artificial intelligence in emergency department triage decisions: Insights from a study with ChatGPT

Implementation considerations for the adoption of artificial intelligence in the emergency department

Artificial intelligence in emergency radiology: A review of applications and possibilities

The Impact of Cultural Embeddedness on the Implementation of an Artificial Intelligence Program at Triage: A Qualitative Study

Needs and expectations for artificial intelligence in emergency medicine according to Canadian physicians

The potential of virtual triage AI to improve early detection, care acuity alignment, and emergent care referral of life-threatening conditions

Artificial intelligence to advance acute and intensive care medicine

Novel ways of applying artificial intelligence in emergency medicine - literature review