Automated Generation of Clinical Reports Using Sensing Technologies with Deep Learning Techniques

Celia Cabello-Collado,Javier Rodriguez-Juan,David Ortiz-Perez,Jose Garcia-Rodriguez,David Tomás,Maria Flores Vizcaya-Moreno

DOI: https://doi.org/10.3390/s24092751

IF: 3.9

2024-04-26

Sensors

Abstract:This study presents a pioneering approach that leverages advanced sensing technologies and data processing techniques to enhance the process of clinical documentation generation during medical consultations. By employing sophisticated sensors to capture and interpret various cues such as speech patterns, intonations, or pauses, the system aims to accurately perceive and understand patient–doctor interactions in real time. This sensing capability allows for the automation of transcription and summarization tasks, facilitating the creation of concise and informative clinical documents. Through the integration of automatic speech recognition sensors, spoken dialogue is seamlessly converted into text, enabling efficient data capture. Additionally, deep models such as Transformer models are utilized to extract and analyze crucial information from the dialogue, ensuring that the generated summaries encapsulate the essence of the consultations accurately. Despite encountering challenges during development, experimentation with these sensing technologies has yielded promising results. The system achieved a maximum ROUGE-1 metric score of 0.57, demonstrating its effectiveness in summarizing complex medical discussions. This sensor-based approach aims to alleviate the administrative burden on healthcare professionals by automating documentation tasks and safeguarding important patient information. Ultimately, by enhancing the efficiency and reliability of clinical documentation, this innovative method contributes to improving overall healthcare outcomes.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

What problem does this paper attempt to address?

The paper aims to address issues in the healthcare sector, particularly the problem of physician burnout due to excessive administrative workload. Specifically, the research proposes an innovative approach that utilizes advanced sensing technology and deep learning techniques to automatically transcribe and summarize conversations between doctors and patients to generate clinical reports. This method aims to reduce the administrative burden of documentation for healthcare professionals, allowing them to devote more time to direct patient care.

The core contributions of the paper include:
1. Developing a system based on Natural Language Processing (NLP) and Automatic Speech Recognition (ASR) to transcribe audio-recorded doctor-patient conversations and extract key information for summarization.
2. Creating a validation set composed of real conversations and their summaries written by medical professionals to evaluate the system's performance.
3. Reducing the paperwork burden on healthcare professionals, thereby improving their daily work quality.

The system employs a series of technical means, including using sensors to capture conversations, ASR technology to convert conversations into text, and deep learning models such as Transformers to analyze and summarize the content of the conversations. In this way, the system can improve the efficiency of generating medical documents while ensuring their quality. Additionally, experimental results show that the system performs excellently in summarizing complex medical discussions, with a high ROUGE-1 score (maximum value of 0.57), demonstrating its potential for practical application.