Abstract:BackgroundThe goal of temporal indexing is to select an occurred time or time interval for each medical entity in clinical notes, so that all medical entities can be indexed on a united timeline, which could assist the understanding of clinical notes and the further application of medical entities. Some temporal relation shared tasks for the medical entity in English clinical notes have been organized in the past few years, such as the 2012 i2b2 NLP challenge, 2015 and 2016 clinical TempEval challenges. In these tasks, many heuristics rule-based and machine learning-based systems have been developed. In recent years, the deep neural network models have shown great potential on many problems including the relation classification.MethodsIn this paper, we propose a recurrent convolutional neural network (RNN-CNN) model for the temporal indexing task, which consists of four layers: input layer - generates representation for each context word of medical entities or temporal expressions; LSTM (long-short term memory) layer - learns the context information of each word in a sentence and outputs a new word representation sequence; CNN layer - extracts meaningful features from a sentence and outputs a new representation for medical entity or temporal expression; Output layer - takes the representations of medical entity, temporal expression and relation features as input and classifies the temporal relation. Finally, the time or time interval for each medical entity can be directly selected according to the probability of each temporal relation predicted by above model.ResultsTo investigate the performance of our RNN-CNN model for the temporal indexing task, several baseline methods were also employed, such as the rule-based, support vector machine (SVM), convolutional neural network (CNN) and recurrent neural network (RNN) methods. Experiments conducted on a manually annotated corpus (including 563 clinical notes with 12,611 medical entities and 4006 temporal expressions) show that RNN-CNN model achieves the best F1-score of 75.97% for temporal relation classification and the best accuracy of 71.96% for temporal indexing.ConclusionsNeural network methods perform much better than the traditional rule-based and SVM-based method, which can capture more semantic information from the context of medical entities and temporal expressions. Besides, all our methods perform much better for the accurate time indexing than the time interval indexing, so how to improve the performance for time interval indexing will be the main focus in our future work.

Towards Practical Temporal Relation Extraction from Clinical Notes: an Analysis of Direct Temporal Relations.

Identifying Direct Temporal Relations Between Time and Events from Clinical Notes

Temporal Expression Recognition and Temporal Relationship Extraction from Chinese Narrative Medical Records

The Automatic Extraction of Temporal Relation from Chinese Narrative Medical Records Using Conditional Random Fields

Empirical Exploration of the Challenges in Temporal Relation Extraction from Clinical Text

A Hybrid System for Temporal Information Extraction from Clinical Text

Chapter-Level Stepwise Temporal Relation Extraction Based on Event Information for Chinese Clinical Medical Texts

Clinical Temporal Relation Extraction with Probabilistic Soft Logic Regularization and Global Inference

Associative attention networks for temporal relation extraction from electronic health records

A system for automatically extracting clinical events with temporal information

Multimodal learning for temporal relation extraction in clinical texts

XJNLP at SemEval-2017 Task 12: Clinical Temporal Information Ex-Traction with a Hybrid Model.

CIES: Clinic Temporal Information Extraction System

DCT-Centered Temporal Relation Extraction.

CMedTEX: A Rule-based Temporal Expression Extraction and Normalization System for Chinese Clinical Notes.

Temporal information extraction with the scalable cross-sentence context for electronic health records

Analysing zero-shot temporal relation extraction on clinical notes using temporal consistency

Temporal Indexing of Medical Entity in Chinese Clinical Notes

An End-to-end System to Identify Temporal Relation in Discharge Summaries: 2012 I2b2 Challenge

Data Reconstruction Based on Temporal Expressions in Clinical Notes

Relation Extraction with Temporal Reasoning Based on Memory Augmented Distant Supervision.