Abstract:Background: Unstructured text in medical records, such as Electronic Health Records, contain an enormous amount of valuable information for research; however, it is difficult to extract and structure important information because of frequent typographical errors. Therefore, improving the quality of data with errors for text analysis is an essential task. To date, few prior studies have been conducted addressing this. Here, we propose a new methodology for extracting important information from unstructured medical texts by overcoming the typographical problem in surgical pathology records related to lung cancer. Methods: We propose a typo correction model that considers context, based on the Masked Language Model, to solve the problem of typographical errors in real-world medical data. In addition, a word dictionary was used for the typo correction model based on PubMed abstracts. After refining the data through typo correction, fine tuning was performed on pre-trained BERT model. Next, deep learning-based Named Entity Recognition (NER) was performed. By solving the quality problem of medical data, we sought to improve the accuracy of information extraction in unstructured text data. Results: We compared the performance of the proposed typo correction model based on contextual information with an existing SymSpell model. We confirmed that our proposed model outperformed the existing model in a typographical correction task. The F1-score of the model improved by approximately 5% and 9% when compared with the model without contextual information in the NCBI-disease and surgical pathology record datasets, respectively. In addition, the F1-score of NER after typo correction increased by 2% in the NCBI-disease dataset. There was a significant performance difference of approximately 25% between the before and after typo correction in the Surgical pathology record dataset. This confirmed that typos influenced the information extraction of the unstructured text. Conclusion: We verified that typographical errors in unstructured text negatively affect the performance of natural language processing tasks. The proposed method of a typo correction model outperformed the existing SymSpell model. This study shows that the proposed model is robust and can be applied in real-world environments by focusing on the typos that cause difficulties in analyzing unstructured medical text.

Exploration of medical record text error correction based on clinical medical record pre- training language model

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

The Development of Personalized Writing Assistant for Electronic Discharge Summaries Based on Named Entity Recognition

Automatic Error Checking and Correction of Electronic Medical Records.

MLM-based typographical error correction of unstructured medical texts for named entity recognition

Improving Clinical Expertise in Large Language Models Using Electronic Medical Records

A data quality improvement method based on non-word errors correction

Topic model based medical record classification method

Integrating Knowledge Retrieval and Large Language Models for Clinical Report Correction

Electronic Medical Data Analysis Based on Word Vector and Deep Learning Model

Medical Aided Diagnosis Using Electronic Medical Records Based On Lda And Word Vector Model

Medical Record Text Analysis Based on Latent Semantic Analysis

WangLab at MEDIQA-CORR 2024: Optimized LLM-based Programs for Medical Error Detection and Correction

Medical entity recognition and knowledge map relationship analysis of Chinese EMRs based on improved BiLSTM-CRF

A Hybrid Approach for Named Entity Recognition in Chinese Electronic Medical Record

Developing a linguistically annotated corpus of Chinese electronic medical record

Improving Chinese Electronic Medical Record Retrieval by Field Weight Assignment, Negation Detection, and Re-ranking

Improving the quality of Persian clinical text with a novel spelling correction system

Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Model

Improving Medical Speech-to-Text Accuracy using Vision-Language Pre-training Models

An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records