Abstract:Objective: Pituitary adenomas are the most common type of pituitary disorders, which usually occur in young adults and often affect the patient's physical development, labor capacity and fertility. Clinical free texts noted in electronic medical records (EMRs) of pituitary adenomas patients contain abundant diagnosis and treatment information. However, this information has not been well utilized because of the challenge to extract information from unstructured clinical texts. This study aims to enable machines to intelligently process clinical information, and automatically extract clinical named entity for pituitary adenomas from Chinese EMRs. Methods: The clinical corpus used in this study was from one pituitary adenomas neurosurgery treatment center of a 3A hospital in China. Four types of fine-grained texts of clinical records were selected, which included notes from present illness, past medical history, case characteristics and family history of 500 pituitary adenoma inpatients. The dictionary-based matching, conditional random fields (CRF), bidirectional long short-term memory with CRF (BiLSTM-CRF), and bidirectional encoder representations from transformers with BiLSTM-CRF (BERT-BiLSTM-CRF) were used to extract clinical entities from a Chinese EMRs corpus. A comprehensive dictionary was constructed based on open source vocabularies and a domain dictionary for pituitary adenomas to conduct the dictionary-based matching method. We selected features such as part of speech, radical, document type, and the position of characters to train the CRF-based model. Random character embeddings and the character embeddings pretrained by BERT were used respectively as the input features for the BiLSTM-CRF model and the BERT-BiLSTM-CRF model. Both strict metric and relaxed metric were used to evaluate the performance of these methods. Results: Experimental results demonstrated that the deep learning and other machine learning methods were able to automatically extract clinical named entities, including symptoms, body regions, diseases, family histories, surgeries, medications, and disease courses of pituitary adenomas from Chinese EMRs. With regard to overall performance, BERT-BiLSTM-CRF has the highest strict F1 value of 91.27% and the highest relaxed F1 value of 95.57% respectively. Additional evaluations showed that BERT-BiLSTM-CRF performed best in almost all entity recognition except surgery and disease course. BiLSTM-CRF performed best in disease course entity recognition, and performed as well as the CRF model for part of speech, radical and document type features, with both strict and relaxed F1 value reaching 96.48%. The CRF model with part of speech, radical and document type features performed best in surgery entity recognition with relaxed F1 value of 95.29%. Conclusions: In this study, we conducted four entity recognition methods for pituitary adenomas based on Chinese EMRs. It demonstrates that the deep learning methods can effectively extract various types of clinical entities with satisfying performance. This study contributed to the clinical named entity extraction from Chinese neurosurgical EMRs. The findings could also assist in information extraction in other Chinese medical texts.

Constructing a Chinese Electronic Medical Record Corpus for Named Entity Recognition on Resident Admit Notes

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

Named Entity Recognition in Chinese Electronic Medical Records Based on CRF.

An Overview of Research on Electronic Medical Record Oriented Named Entity Recognition and Entity Relation Extraction

Named Entity Extraction for Chinese Electronic Medical Records.

A comprehensive study of named entity recognition in Chinese clinical text

A Feature-Enhanced Entity Recognition Method for Chinese Electronic Medical Records

A self-attention based neural architecture for Chinese medical named entity recognition

Chinese Clinical Named Entity Recognition From Electronic Medical Records Based on Multisemantic Features by Using Robustly Optimized Bidirectional Encoder Representation From Transformers Pretraining Approach Whole Word Masking and Convolutional Neural Networks: Model Development and Validation

Overview of CCKS 2018 Task 1 - Named Entity Recognition in Chinese Electronic Medical Records.

Chinese EMR Named Entity Recognition Using Fused Label Relations Based on Machine Reading Comprehension Framework

Chinese Medical Named Entity Recognition using CRF-MT-Adapt and NER-MRC

A multitask bi-directional RNN model for named entity recognition on Chinese electronic medical records

Named entity recognition in Chinese electronic medical records based on multi-feature integration

A Hybrid Approach for Named Entity Recognition in Chinese Electronic Medical Record

Construction, evaluation, and application of an electronic medical record corpus for cerebral palsy rehabilitation

Medical Knowledge Attention Enhanced Neural Model for Named Entity Recognition in Chinese EMR.

Improving the Named Entity Recognition of Chinese Electronic Medical Records by Combining Domain Dictionary and Rules

A unified framework of medical information annotation and extraction for Chinese clinical text

Extracting clinical named entity for pituitary adenomas from Chinese electronic medical records