Abstract:Background: Unstructured text in medical records, such as Electronic Health Records, contain an enormous amount of valuable information for research; however, it is difficult to extract and structure important information because of frequent typographical errors. Therefore, improving the quality of data with errors for text analysis is an essential task. To date, few prior studies have been conducted addressing this. Here, we propose a new methodology for extracting important information from unstructured medical texts by overcoming the typographical problem in surgical pathology records related to lung cancer. Methods: We propose a typo correction model that considers context, based on the Masked Language Model, to solve the problem of typographical errors in real-world medical data. In addition, a word dictionary was used for the typo correction model based on PubMed abstracts. After refining the data through typo correction, fine tuning was performed on pre-trained BERT model. Next, deep learning-based Named Entity Recognition (NER) was performed. By solving the quality problem of medical data, we sought to improve the accuracy of information extraction in unstructured text data. Results: We compared the performance of the proposed typo correction model based on contextual information with an existing SymSpell model. We confirmed that our proposed model outperformed the existing model in a typographical correction task. The F1-score of the model improved by approximately 5% and 9% when compared with the model without contextual information in the NCBI-disease and surgical pathology record datasets, respectively. In addition, the F1-score of NER after typo correction increased by 2% in the NCBI-disease dataset. There was a significant performance difference of approximately 25% between the before and after typo correction in the Surgical pathology record dataset. This confirmed that typos influenced the information extraction of the unstructured text. Conclusion: We verified that typographical errors in unstructured text negatively affect the performance of natural language processing tasks. The proposed method of a typo correction model outperformed the existing SymSpell model. This study shows that the proposed model is robust and can be applied in real-world environments by focusing on the typos that cause difficulties in analyzing unstructured medical text.

Building a Japanese Typo Dataset and Typo Correction System Based on Wikipedia’s Revision History

Correcting the Autocorrect: Context-Aware Typographical Error Correction via Training Data Augmentation

Automatic Correction of Human Translations

Correcting diacritics and typos with a ByT5 transformer model

Assessing the Efficacy of Grammar Error Correction: A Human Evaluation Approach in the Japanese Context

JaPOC: Japanese Post-OCR Correction Benchmark using Vouchers

Type-R: Automatically Retouching Typos for Text-to-Image Generation

Persian Typographical Error Type Detection Using Deep Neural Networks on Algorithmically-Generated Misspellings

MLM-based typographical error correction of unstructured medical texts for named entity recognition

Japanese-Spanish Thesaurus Construction Using English as a Pivot

Autocorrect in the Process of Translation -- Multi-task Learning Improves Dialogue Machine Translation

Japanese Legal Term Correction using Random Forest

Correction of Errors in a Modality Corpus Used for Machine Translation by Using Machine-learning Method

Comparison of Grammatical Error Correction Using Back-Translation Models

Domain specificity and data efficiency in typo tolerant spell checkers: the case of search in online marketplaces

A Computational Neural Network Model for College English Grammar Correction

Accent Estimation of Japanese Words from Their Surfaces and Romanizations for Building Large Vocabulary Accent Dictionaries

llm-japanese-dataset v0: Construction of Japanese Chat Dataset for Large Language Models and its Methodology

Towards standardizing Korean Grammatical Error Correction: Datasets and Annotation

Byte-Level Grammatical Error Correction Using Synthetic and Curated Corpora

Japanese-English Sentence Translation Exercises Dataset for Automatic Grading