Abstract:Purpose: Cutting-edge automatic speech recognition (ASR) technology holds significant promise in transcribing and recognizing medical information during patient encounters, thereby enabling automatic and real-time clinical documentation, which could significantly alleviate care clinicians' burdens. Nevertheless, the performance of current-generation ASR technology in analyzing conversations in noisy and dynamic medical settings, such as prehospital or Emergency Medical Services (EMS), lacks sufficient validation. This study explores the current technological limitations and future potential of deploying ASR technology for clinical documentation in fastpaced and noisy medical settings such as EMS. Methods: In this study, we evaluated four ASR engines, including Google Speech-to-Text Clinical Conversation, OpenAI Speech-to-Text, Amazon Transcribe Medical, and Azure Speech-to-Text engine. The empirical data used for evaluation were 40 EMS simulation recordings. The transcribed texts were analyzed for accuracy against 23 Electronic Health Records (EHR) categories of EMS. The common types of errors in transcription were also analyzed. Results: Among all four ASR engines, Google Speech-to-Text Clinical Conversation performed the best. Among all EHR categories, better performance was observed in categories "mental state" (F1 = 1.0), "allergies" (F1 = 0.917), "past medical history" (F1 = 0.804), "electrolytes" (F1 = 1.0), and "blood glucose level" (F1 = 0.813). However, all four ASR engines demonstrated low performance in transcribing certain critical categories, such as "treatment" (F1 = 0.650) and "medication" (F1 = 0.577). Conclusion: Current ASR solutions fall short in fully automating the clinical documentation in EMS setting. Our findings highlight the need for further improvement and development of automated clinical documentation technology to improve recognition accuracy in time-critical and dynamic medical settings.

Development of an ASR System for Medical Conversations

The Sound of Healthcare: Improving Medical Transcription ASR Accuracy with Large Language Models

Development of Hybrid ASR Systems for Low Resource Medical Domain Conversational Telephone Speech

Performant ASR Models for Medical Entities in Accented Speech

Speech recognition for medical conversations

High-precision medical speech recognition through synthetic data and semantic correction: UNITED-MEDASR

Automated Generation of Clinical Reports Using Sensing Technologies with Deep Learning Techniques

Towards an Automated SOAP Note: Classifying Utterances from Medical Conversations

Assessing the Effectiveness of Automatic Speech Recognition Technology in Emergency Medicine Settings: A Comparative Study of Four AI-powered Engines

Automatic documentation of professional health interactions: A systematic review

Clinical Dialogue Transcription Error Correction using Seq2Seq Models

Evaluation of state-of-the-art ASR Models in Child-Adult Interactions

Optimizing medical personnel speech recognition models using speech synthesis and reinforcement learning

MEDSAGE: Enhancing Robustness of Medical Dialogue Summarization to ASR Errors with LLM-generated Synthetic Dialogues

Automated translation accurately translates recorded pediatric neurosurgery clinic conversations between Spanish and English

PriMock57: A Dataset Of Primary Care Mock Consultations

Revolutionizing Radiological Analysis: The Future of French Language Automatic Speech Recognition in Healthcare

Spoken Dialogue System for Medical Prescription Acquisition on Smartphone: Development, Corpus and Evaluation

Building an ASR Error Robust Spoken Virtual Patient System in a Highly Class-Imbalanced Scenario Without Speech Data

Automatic analysis of medical dialogue in the home hemodialysis domain: Structure induction and summarization

MultiMed: Multilingual Medical Speech Recognition via Attention Encoder Decoder