Abstract:BACKGROUND:Entity recognition is one of the most primary steps for text analysis and has long attracted considerable attention from researchers. In the clinical domain, various types of entities, such as clinical entities and protected health information (PHI), widely exist in clinical texts. Recognizing these entities has become a hot topic in clinical natural language processing (NLP), and a large number of traditional machine learning methods, such as support vector machine and conditional random field, have been deployed to recognize entities from clinical texts in the past few years. In recent years, recurrent neural network (RNN), one of deep learning methods that has shown great potential on many problems including named entity recognition, also has been gradually used for entity recognition from clinical texts.METHODS:In this paper, we comprehensively investigate the performance of LSTM (long-short term memory), a representative variant of RNN, on clinical entity recognition and protected health information recognition. The LSTM model consists of three layers: input layer - generates representation of each word of a sentence; LSTM layer - outputs another word representation sequence that captures the context information of each word in this sentence; Inference layer - makes tagging decisions according to the output of LSTM layer, that is, outputting a label sequence.RESULTS:Experiments conducted on corpora of the 2010, 2012 and 2014 i2b2 NLP challenges show that LSTM achieves highest micro-average F1-scores of 85.81% on the 2010 i2b2 medical concept extraction, 92.29% on the 2012 i2b2 clinical event detection, and 94.37% on the 2014 i2b2 de-identification, which is considerably competitive with other state-of-the-art systems.CONCLUSIONS:LSTM that requires no hand-crafted feature has great potential on entity recognition from clinical texts. It outperforms traditional machine learning methods that suffer from fussy feature engineering. A possible future direction is how to integrate knowledge bases widely existing in the clinical domain into LSTM, which is a case of our future work. Moreover, how to use LSTM to recognize entities in specific formats is also another possible future direction.

Sensitive Information Detection: Recursive Neural Networks for Encoding Context

Sensitive Data Detection with High-Throughput Neural Network Models for Financial Institutions

A Graph Convolutional Network-Based Sensitive Information Detection Algorithm

How recurrent networks implement contextual processing in sentiment analysis

Privacy BERT-LSTM: a novel NLP algorithm for sensitive information detection in textual documents

Recurrent Neural Network Language Models for Open Vocabulary Event-Level Cyber Anomaly Detection

A Language-Independent Neural Network for Event Detection

Detecting the Insider Threat with Long Short Term Memory (LSTM) Neural Networks

Adverse Drug Event Detection from Electronic Health Records Using Hierarchical Recurrent Neural Networks with Dual-Level Embedding

LSTM Recurrent Neural Networks for Cybersecurity Named Entity Recognition

An Investigation of Recurrent Neural Architectures for Drug Name Recognition

A Programmatic and Semantic Approach to Explaining and DebuggingNeural Network Based Object Detectors

Network Traffic Anomaly Detection Using Recurrent Neural Networks

Semantic Role Labeling Using Recursive Neural Network

End-To-End Anomaly Detection for Identifying Malicious Cyber Behavior through NLP-Based Log Embeddings

Entity Recognition from Clinical Texts Via Recurrent Neural Network

Text Backdoor Detection Using an Interpretable RNN Abstract Model.

Hierarchical Contextualized Representation for Named Entity Recognition.

DANES: Deep Neural Network Ensemble Architecture for Social and Textual Context-aware Fake News Detection

NLP based Deep Learning Approach for Plagiarism Detection

When and Where Did it Happen? An Encoder-Decoder Model to Identify Scenario Context