Abstract:BACKGROUND:Entity recognition is one of the most primary steps for text analysis and has long attracted considerable attention from researchers. In the clinical domain, various types of entities, such as clinical entities and protected health information (PHI), widely exist in clinical texts. Recognizing these entities has become a hot topic in clinical natural language processing (NLP), and a large number of traditional machine learning methods, such as support vector machine and conditional random field, have been deployed to recognize entities from clinical texts in the past few years. In recent years, recurrent neural network (RNN), one of deep learning methods that has shown great potential on many problems including named entity recognition, also has been gradually used for entity recognition from clinical texts.METHODS:In this paper, we comprehensively investigate the performance of LSTM (long-short term memory), a representative variant of RNN, on clinical entity recognition and protected health information recognition. The LSTM model consists of three layers: input layer - generates representation of each word of a sentence; LSTM layer - outputs another word representation sequence that captures the context information of each word in this sentence; Inference layer - makes tagging decisions according to the output of LSTM layer, that is, outputting a label sequence.RESULTS:Experiments conducted on corpora of the 2010, 2012 and 2014 i2b2 NLP challenges show that LSTM achieves highest micro-average F1-scores of 85.81% on the 2010 i2b2 medical concept extraction, 92.29% on the 2012 i2b2 clinical event detection, and 94.37% on the 2014 i2b2 de-identification, which is considerably competitive with other state-of-the-art systems.CONCLUSIONS:LSTM that requires no hand-crafted feature has great potential on entity recognition from clinical texts. It outperforms traditional machine learning methods that suffer from fussy feature engineering. A possible future direction is how to integrate knowledge bases widely existing in the clinical domain into LSTM, which is a case of our future work. Moreover, how to use LSTM to recognize entities in specific formats is also another possible future direction.

Chinese Clinical Entity Recognition Via Attention-Based CNN-LSTM-CRF

Entity Recognition in Chinese Clinical Text Using Attention-Based CNN-LSTM-CRF

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

Chinese Clinical Named Entity Recognition Via Multi-Head Self-Attention Based BiLSTM-CRF

Incorporating multi-level CNN and attention mechanism for Chinese clinical named entity recognition

An Attention-Based BiLSTM-CRF Model for Chinese Clinic Named Entity Recognition

Chinese Clinical Named Entity Recognition Using Residual Dilated Convolutional Neural Network with Conditional Random Field.

Fast and Accurate Recognition of Chinese Clinical Named Entities with Residual Dilated Convolutions

An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records

Medical Named Entity Extraction From Chinese Resident Admit Notes Using Character And Word Attention-Enhanced Neural Network

End-to-End Chinese Entity Recognition Based on BERT-BiLSTM-ATT-CRF

Character-Based Deep Learning Approaches for Clinical Named Entity Recognition: A Comparative Study Using Chinese EHR Texts.

Chinese clinical named entity recognition based on stacked neural network

Entity Recognition of Chinese Electronic Medical Record Based on Gated Graph Neural Network

Adversarial training based lattice LSTM for Chinese clinical named entity recognition

Incorporating Dynamic Attention Gating Mechanism and Pre-Trained Embedding for Chinese Clinical Named Entity Recognition

A Method of Chinese Named Entity Recognition Based on CNN-BILSTM-CRF Model.

Entity Recognition from Clinical Texts Via Recurrent Neural Network

Neural Chinese Named Entity Recognition via CNN-LSTM-CRF and Joint Training with Word Segmentation

Named Entity Recognition In Chinese Electronic Medical Record Using Attention Mechanism

A Multi Neural Networks based Approach to Complex Chinese Medical Named Entity Recognition