Abstract:Objective: Pituitary adenomas are the most common type of pituitary disorders, which usually occur in young adults and often affect the patient's physical development, labor capacity and fertility. Clinical free texts noted in electronic medical records (EMRs) of pituitary adenomas patients contain abundant diagnosis and treatment information. However, this information has not been well utilized because of the challenge to extract information from unstructured clinical texts. This study aims to enable machines to intelligently process clinical information, and automatically extract clinical named entity for pituitary adenomas from Chinese EMRs. Methods: The clinical corpus used in this study was from one pituitary adenomas neurosurgery treatment center of a 3A hospital in China. Four types of fine-grained texts of clinical records were selected, which included notes from present illness, past medical history, case characteristics and family history of 500 pituitary adenoma inpatients. The dictionary-based matching, conditional random fields (CRF), bidirectional long short-term memory with CRF (BiLSTM-CRF), and bidirectional encoder representations from transformers with BiLSTM-CRF (BERT-BiLSTM-CRF) were used to extract clinical entities from a Chinese EMRs corpus. A comprehensive dictionary was constructed based on open source vocabularies and a domain dictionary for pituitary adenomas to conduct the dictionary-based matching method. We selected features such as part of speech, radical, document type, and the position of characters to train the CRF-based model. Random character embeddings and the character embeddings pretrained by BERT were used respectively as the input features for the BiLSTM-CRF model and the BERT-BiLSTM-CRF model. Both strict metric and relaxed metric were used to evaluate the performance of these methods. Results: Experimental results demonstrated that the deep learning and other machine learning methods were able to automatically extract clinical named entities, including symptoms, body regions, diseases, family histories, surgeries, medications, and disease courses of pituitary adenomas from Chinese EMRs. With regard to overall performance, BERT-BiLSTM-CRF has the highest strict F1 value of 91.27% and the highest relaxed F1 value of 95.57% respectively. Additional evaluations showed that BERT-BiLSTM-CRF performed best in almost all entity recognition except surgery and disease course. BiLSTM-CRF performed best in disease course entity recognition, and performed as well as the CRF model for part of speech, radical and document type features, with both strict and relaxed F1 value reaching 96.48%. The CRF model with part of speech, radical and document type features performed best in surgery entity recognition with relaxed F1 value of 95.29%. Conclusions: In this study, we conducted four entity recognition methods for pituitary adenomas based on Chinese EMRs. It demonstrates that the deep learning methods can effectively extract various types of clinical entities with satisfying performance. This study contributed to the clinical named entity extraction from Chinese neurosurgical EMRs. The findings could also assist in information extraction in other Chinese medical texts.

Named Entity Extraction for Chinese Electronic Medical Records.

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

Named Entity Recognition in Chinese Electronic Medical Records Based on CRF.

Overview of CCKS 2018 Task 1 - Named Entity Recognition in Chinese Electronic Medical Records.

Improving the Named Entity Recognition of Chinese Electronic Medical Records by Combining Domain Dictionary and Rules

A multitask bi-directional RNN model for named entity recognition on Chinese electronic medical records

Medical entity recognition and knowledge map relationship analysis of Chinese EMRs based on improved BiLSTM-CRF

A self-attention based neural architecture for Chinese medical named entity recognition

Deep learning for named entity recognition on Chinese electronic medical records: Combining deep transfer learning with multitask bi-directional LSTM RNN

Chinese Clinical Named Entity Recognition From Electronic Medical Records Based on Multisemantic Features by Using Robustly Optimized Bidirectional Encoder Representation From Transformers Pretraining Approach Whole Word Masking and Convolutional Neural Networks: Model Development and Validation

Named Entity Recognition of Chinese Electronic Medical Records Based on Cascaded Conditional Random Field

Extracting clinical named entity for pituitary adenomas from Chinese electronic medical records

Deep Learning Based Information Extraction Framework on Chinese Electronic Health Records

A dictionary-guided attention network for biomedical named entity recognition in Chinese electronic medical records

Named entity recognition of Chinese electronic medical records based on a hybrid neural network and medical MC-BERT

Named entity recognition in Chinese electronic medical records based on multi-feature integration

An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records

Medical Knowledge Attention Enhanced Neural Model for Named Entity Recognition in Chinese EMR.

Chinese Medical Named Entity Recognition using CRF-MT-Adapt and NER-MRC

Chinese medical entity recognition based on the dual-branch TENER model