Abstract:Traditional electronic medical record systems in hospitals rely on healthcare workers to manually enter patient information, resulting in healthcare workers having to spend a significant amount of time each day filling out electronic medical records. This inefficient interaction seriously affects the communication between doctors and patients and reduces the speed at which doctors can diagnose patients’ conditions. The rapid development of deep learning–based speech recognition technology promises to improve this situation. In this work, we build an online electronic medical record system based on speech interaction. The system integrates a medical linguistic knowledge base, a specialized language model, a personalized acoustic model, and a fault-tolerance mechanism. Hence, we propose and develop an advanced electronic medical record system approach with multi-accent adaptive technology for avoiding the mistakes caused by accents, and it improves the accuracy of speech recognition obviously. For testing the proposed speech recognition electronic medical record system, we construct medical speech recognition data sets using audio and electronic medical records from real medical environments. On the data sets from real clinical scenarios, our proposed algorithm significantly outperforms other machine learning algorithms. Furthermore, compared to traditional electronic medical record systems that rely on keyboard inputs, our system is much more efficient, and its accuracy rate increases with the increasing online time of the proposed system. Our results show that the proposed electronic medical record system is expected to revolutionize the traditional working approach of clinical departments, and it serves more efficient in clinics with low time consumption compared with traditional electronic medical record systems depending on keyboard inputs, which has less recording mistakes and lows down the time consumption in modification of medical recordings; due to the proposed speech recognition electronic medical record system is built on knowledge database of medical terms, so it has a good generalized application and adaption in the clinical scenarios for hospitals.

Speech recognition for medical conversations

The Sound of Healthcare: Improving Medical Transcription ASR Accuracy with Large Language Models

An Online Intelligent Electronic Medical Record System Via Speech Recognition

Development of an ASR System for Medical Conversations

Clinical Dialogue Transcription Error Correction using Seq2Seq Models

Searching for Best Practices in Medical Transcription with Large Language Model

Conversational System for Clinical Communication Training Supporting User-defined Tasks.

MultiMed: Multilingual Medical Speech Recognition via Attention Encoder Decoder

Automating Feedback Analysis in Surgical Training: Detection, Categorization, and Assessment

Optimizing medical personnel speech recognition models using speech synthesis and reinforcement learning

A Speaker-Aware Co-Attention Framework for Medical Dialogue Information Extraction

Towards an Automated SOAP Note: Classifying Utterances from Medical Conversations

Deep learning-based natural language processing for detecting medical symptoms and histories in emergency patient triage

Real-time Speech Summarization for Medical Conversations

Clinical BERTScore: An Improved Measure of Automatic Speech Recognition Performance in Clinical Settings

Assessing the Effectiveness of Automatic Speech Recognition Technology in Emergency Medicine Settings: A Comparative Study of Four AI-powered Engines

ChatDoctor: A Medical Chat Model Fine-tuned on LLaMA Model using Medical Domain Knowledge

Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialogue

High-precision medical speech recognition through synthetic data and semantic correction: UNITED-MEDASR

State-of-the-Art Speech Recognition with Sequence-to-Sequence Models

Speech Emotion Recognition Applied to Real-World Medical Consultation