Abstract:BackgroundThe goal of temporal indexing is to select an occurred time or time interval for each medical entity in clinical notes, so that all medical entities can be indexed on a united timeline, which could assist the understanding of clinical notes and the further application of medical entities. Some temporal relation shared tasks for the medical entity in English clinical notes have been organized in the past few years, such as the 2012 i2b2 NLP challenge, 2015 and 2016 clinical TempEval challenges. In these tasks, many heuristics rule-based and machine learning-based systems have been developed. In recent years, the deep neural network models have shown great potential on many problems including the relation classification.MethodsIn this paper, we propose a recurrent convolutional neural network (RNN-CNN) model for the temporal indexing task, which consists of four layers: input layer - generates representation for each context word of medical entities or temporal expressions; LSTM (long-short term memory) layer - learns the context information of each word in a sentence and outputs a new word representation sequence; CNN layer - extracts meaningful features from a sentence and outputs a new representation for medical entity or temporal expression; Output layer - takes the representations of medical entity, temporal expression and relation features as input and classifies the temporal relation. Finally, the time or time interval for each medical entity can be directly selected according to the probability of each temporal relation predicted by above model.ResultsTo investigate the performance of our RNN-CNN model for the temporal indexing task, several baseline methods were also employed, such as the rule-based, support vector machine (SVM), convolutional neural network (CNN) and recurrent neural network (RNN) methods. Experiments conducted on a manually annotated corpus (including 563 clinical notes with 12,611 medical entities and 4006 temporal expressions) show that RNN-CNN model achieves the best F1-score of 75.97% for temporal relation classification and the best accuracy of 71.96% for temporal indexing.ConclusionsNeural network methods perform much better than the traditional rule-based and SVM-based method, which can capture more semantic information from the context of medical entities and temporal expressions. Besides, all our methods perform much better for the accurate time indexing than the time interval indexing, so how to improve the performance for time interval indexing will be the main focus in our future work.

XJNLP at SemEval-2017 Task 12: Clinical Temporal Information Ex-Traction with a Hybrid Model.

Temporal Expression Recognition and Temporal Relationship Extraction from Chinese Narrative Medical Records

The Automatic Extraction of Temporal Relation from Chinese Narrative Medical Records Using Conditional Random Fields

Empirical Exploration of the Challenges in Temporal Relation Extraction from Clinical Text

A Hybrid System for Temporal Information Extraction from Clinical Text

A system for automatically extracting clinical events with temporal information

Extraction of Medication and Temporal Relation from Clinical Text using Neural Language Models

Temporal information extraction with the scalable cross-sentence context for electronic health records

A Temporal Model in Electronic Health Record Search

Towards Practical Temporal Relation Extraction from Clinical Notes: an Analysis of Direct Temporal Relations.

Associative attention networks for temporal relation extraction from electronic health records

CMedTEX: A Rule-based Temporal Expression Extraction and Normalization System for Chinese Clinical Notes.

Data-Driven Approach Based On Semantic Roles For Recognizing Temporal Expressions And Events In Chinese

CIES: Clinic Temporal Information Extraction System

Extracting Event Temporal Information Based on Web

Identifying Direct Temporal Relations Between Time and Events from Clinical Notes

Joint Extraction of Events in Chinese Electronic Medical Records

Temporal Indexing of Medical Entity in Chinese Clinical Notes

XLTime: A Cross-Lingual Knowledge Transfer Framework for Temporal Expression Extraction

Multimodal learning for temporal relation extraction in clinical texts

Extracting and Normalizing Temporal Expressions in Clinical Data Requests from Researchers