Abstract:Traditional electronic medical record systems in hospitals rely on healthcare workers to manually enter patient information, resulting in healthcare workers having to spend a significant amount of time each day filling out electronic medical records. This inefficient interaction seriously affects the communication between doctors and patients and reduces the speed at which doctors can diagnose patients’ conditions. The rapid development of deep learning–based speech recognition technology promises to improve this situation. In this work, we build an online electronic medical record system based on speech interaction. The system integrates a medical linguistic knowledge base, a specialized language model, a personalized acoustic model, and a fault-tolerance mechanism. Hence, we propose and develop an advanced electronic medical record system approach with multi-accent adaptive technology for avoiding the mistakes caused by accents, and it improves the accuracy of speech recognition obviously. For testing the proposed speech recognition electronic medical record system, we construct medical speech recognition data sets using audio and electronic medical records from real medical environments. On the data sets from real clinical scenarios, our proposed algorithm significantly outperforms other machine learning algorithms. Furthermore, compared to traditional electronic medical record systems that rely on keyboard inputs, our system is much more efficient, and its accuracy rate increases with the increasing online time of the proposed system. Our results show that the proposed electronic medical record system is expected to revolutionize the traditional working approach of clinical departments, and it serves more efficient in clinics with low time consumption compared with traditional electronic medical record systems depending on keyboard inputs, which has less recording mistakes and lows down the time consumption in modification of medical recordings; due to the proposed speech recognition electronic medical record system is built on knowledge database of medical terms, so it has a good generalized application and adaption in the clinical scenarios for hospitals.

Building an ASR Error Robust Spoken Virtual Patient System in a Highly Class-Imbalanced Scenario Without Speech Data

VarASV: Enabling Pitch-variable Automatic Speaker Verification Via Multi-task Learning

Artificial intelligence in virtual standardized patients: Combining natural language understanding and rule based dialogue management to improve conversational fidelity

VAIS ASR: Building a conversational speech recognition system using language model combination

Robust Spoken Language Understanding With Unsupervised Asr-Error Adaptation

Error-preserving Automatic Speech Recognition of Young English Learners' Language

Developing vocal system impaired patient-aimed voice quality assessment approach using ASR representation-included multiple features

Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Model

Improving Medical Speech-to-Text Accuracy using Vision-Language Pre-training Models

Investigation of Error Simulation Techniques for Learning Dialog Policies for Conversational Error Recovery

Voice-Enabled Response Analysis Agent (VERAA): Leveraging Large Language Models to Map Voice Responses in SDoH Survey

High-precision medical speech recognition through synthetic data and semantic correction: UNITED-MEDASR

Leveraging Large Language Models for Exploiting ASR Uncertainty

Server-side Rescoring of Spoken Entity-centric Knowledge Queries for Virtual Assistants

PCAD: Towards ASR-Robust Spoken Language Understanding via Prototype Calibration and Asymmetric Decoupling

Creating Spoken Dialog Systems in Ultra-Low Resourced Settings

Performance evaluation of SLAM-ASR: The Good, the Bad, the Ugly, and the Way Forward

Unsupervised Pre-Training for Vietnamese Automatic Speech Recognition in the HYKIST Project

An Online Intelligent Electronic Medical Record System Via Speech Recognition

Situated Understanding of Errors in Older Adults' Interactions with Voice Assistants: A Month-Long, In-Home Study

Robust Spoken Language Understanding with RL-based Value Error Recovery