Abstract:Abstract Background Clinical named entity recognition (CNER) is important for medical information mining and establishment of high-quality knowledge map. Due to the different text features from natural language and a large number of professional and uncommon clinical terms in Chinese electronic medical records (EMRs), there are still many difficulties in clinical named entity recognition of Chinese EMRs. It is of great importance to eliminate semantic interference and improve the ability of autonomous learning of internal features of the model under the small training corpus. Methods From the perspective of deep learning, we integrated the attention mechanism into neural network, and proposed an improved clinical named entity recognition method for Chinese electronic medical records called BiLSTM-Att-CRF, which could capture more useful information of the context and avoid the problem of missing information caused by long-distance factors. In addition, medical dictionaries and part-of-speech (POS) features were also introduced to improve the performance of the model. Results Based on China Conference on Knowledge Graph and Semantic Computing (CCKS) 2017 and 2018 Chinese EMRs corpus, our BiLSTM-Att-CRF model finally achieved better performance than other widely-used models without additional features(F1-measure of 85.4% in CCKS 2018, F1-measure of 90.29% in CCKS 2017), and achieved the best performance with POS and dictionary features (F1-measure of 86.11% in CCKS 2018, F1-measure of 90.48% in CCKS 2017). In particular, the BiLSTM-Att-CRF model had significant effect on the improvement of Recall. Conclusions Our work preliminarily confirmed the validity of attention mechanism in discovering key information and mining text features, which might provide useful ideas for future research in clinical named entity recognition of Chinese electronic medical records. In the future, we will explore the deeper application of attention mechanism in neural network.

Extracting Entities with Attributes in Clinical Text Via Joint Deep Learning.

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

A joint entity Relation Extraction method for document level Traditional Chinese Medicine texts

Entity Recognition in Chinese Clinical Text Using Attention-Based CNN-LSTM-CRF

Joint extraction of entities and relations via an entity correlated attention neural model

A neural network-based joint learning approach for biomedical entity and relation extraction from biomedical literature

Extracting Family History of Patients from Clinical Narratives: Exploring an End-to-End Solution with Deep Learning Models.

Fine-tuning BERT for Joint Entity and Relation Extraction in Chinese Medical Text

A Discrete Joint Model for Entity and Relation Extraction from Clinical Notes

A neural joint model for entity and relation extraction from biomedical text

Joint Model of Entity Recognition and Relation Extraction with Self-attention Mechanism

Modeling of joint extraction of entity relationships in clinical electronic medical records

A Novel Approach Towards Medical Entity Recognition in Chinese Clinical Text.

An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records

A Study of Deep Learning Approaches for Medication and Adverse Drug Event Extraction from Clinical Text.

Entity relation extraction from electronic medical records based on improved annotation rules and BiLSTM-CRF

Research on Chinese medical named entity recognition based on collaborative cooperation of multiple neural network models

A Hybrid Approach for Named Entity Recognition in Chinese Electronic Medical Record

Extraction of Traditional Chinese Medicine Entity: Design of a Novel Span-Level Named Entity Recognition Method With Distant Supervision

Hitsz-cner: A hybrid system for entity recognition from Chinese clinical text

A tag based joint extraction model for Chinese medical text