Abstract:BACKGROUND:Entity recognition is one of the most primary steps for text analysis and has long attracted considerable attention from researchers. In the clinical domain, various types of entities, such as clinical entities and protected health information (PHI), widely exist in clinical texts. Recognizing these entities has become a hot topic in clinical natural language processing (NLP), and a large number of traditional machine learning methods, such as support vector machine and conditional random field, have been deployed to recognize entities from clinical texts in the past few years. In recent years, recurrent neural network (RNN), one of deep learning methods that has shown great potential on many problems including named entity recognition, also has been gradually used for entity recognition from clinical texts.METHODS:In this paper, we comprehensively investigate the performance of LSTM (long-short term memory), a representative variant of RNN, on clinical entity recognition and protected health information recognition. The LSTM model consists of three layers: input layer - generates representation of each word of a sentence; LSTM layer - outputs another word representation sequence that captures the context information of each word in this sentence; Inference layer - makes tagging decisions according to the output of LSTM layer, that is, outputting a label sequence.RESULTS:Experiments conducted on corpora of the 2010, 2012 and 2014 i2b2 NLP challenges show that LSTM achieves highest micro-average F1-scores of 85.81% on the 2010 i2b2 medical concept extraction, 92.29% on the 2012 i2b2 clinical event detection, and 94.37% on the 2014 i2b2 de-identification, which is considerably competitive with other state-of-the-art systems.CONCLUSIONS:LSTM that requires no hand-crafted feature has great potential on entity recognition from clinical texts. It outperforms traditional machine learning methods that suffer from fussy feature engineering. A possible future direction is how to integrate knowledge bases widely existing in the clinical domain into LSTM, which is a case of our future work. Moreover, how to use LSTM to recognize entities in specific formats is also another possible future direction.

Information Extraction from Electronic Medical Records Using Multitask Recurrent Neural Network with Contextual Word Embedding

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

A multitask bi-directional RNN model for named entity recognition on Chinese electronic medical records

A Multichannel Biomedical Named Entity Recognition Model Based on Multitask Learning and Contextualized Word Representations

Research of Clinical Named Entity Recognition Based on Bi-LSTM-CRF

Entity Recognition from Clinical Texts Via Recurrent Neural Network

Medical named entity recognition of Chinese electronic medical records based on stacked Bidirectional Long Short-Term Memory

An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records

A self-attention based neural architecture for Chinese medical named entity recognition

Deep learning for named entity recognition on Chinese electronic medical records: Combining deep transfer learning with multitask bi-directional LSTM RNN

A Named Entity Recognition Approach for Electronic Medical Records Using BERT Semantic Enhancement and BiLSTM

Named Entity Recognition for Chinese Electronic Medical Records Based on Multitask and Transfer Learning

A Bidirectional LSTM and Conditional Random Fields Approach to Medical Named Entity Recognition.

Entity relation extraction from electronic medical records based on improved annotation rules and BiLSTM-CRF

Named Entity Recognition from Biomedical Texts Using a Fusion Attention-Based BiLSTM-CRF.

Long short-term memory RNN for biomedical named entity recognition

Improving the Named Entity Recognition of Chinese Electronic Medical Records by Combining Domain Dictionary and Rules

Language model based on deep learning network for biomedical named entity recognition

Biomedical named entity recognition using deep neural networks with contextual information

Information Extraction of Chinese Medical Electronic Records Via Evolutionary Neural Architecture Search

Medical entity recognition and knowledge map relationship analysis of Chinese EMRs based on improved BiLSTM-CRF