Abstract:BackgroundExtracting relations between important clinical entities is critical but very challenging for natural language processing (NLP) in the medical domain. Researchers have applied deep learning-based approaches to clinical relation extraction; but most of them consider sentence sequence only, without modeling syntactic structures. The aim of this study was to utilize a deep neural network to capture the syntactic features and further improve the performances of relation extraction in clinical notes.MethodsWe propose a novel neural approach to model shortest dependency path (SDP) between target entities together with the sentence sequence for clinical relation extraction. Our neural network architecture consists of three modules: (1) sentence sequence representation module using bidirectional long short-term memory network (Bi-LSTM) to capture the features in the sentence sequence; (2) SDP representation module implementing the convolutional neural network (CNN) and Bi-LSTM network to capture the syntactic context for target entities using SDP information; and (3) classification module utilizing a fully-connected layer with Softmax function to classify the relation type between target entities.ResultsUsing the 2010 i2b2/VA relation extraction dataset, we compared our approach with other baseline methods. Our experimental results show that the proposed approach achieved significant improvements over comparable existing methods, demonstrating the effectiveness of utilizing syntactic structures in deep learning-based relation extraction. The F-measure of our method reaches 74.34% which is 2.5% higher than the method without using syntactic features.ConclusionsWe propose a new neural network architecture by modeling SDP along with sentence sequence to extract multi-relations from clinical text. Our experimental results show that the proposed approach significantly improve the performances on clinical notes, demonstrating the effectiveness of syntactic structures in deep learning-based relation extraction.

Convolutional LSTM Network with Hierarchical Attention for Relation Classification in Clinical Texts.

Classifying medical relations in clinical text via convolutional neural networks

Relation Classification Via Recurrent Neural Network with Attention and Tensor Layers

Relation Classification Via Multi-Level Attention CNNs.

Relation Classification Via LSTMs Based on Sequence and Tree Structure.

A Hierarchical Convolutional Model for Biomedical Relation Extraction

Convolutional Gated Recurrent Units for Medical Relation Classification

Recurrent neural networks with segment attention and entity description for relation extraction from clinical texts

Relation Classification Using Revised Convolutional Neural Networks.

Clinical Relation Extraction via Dual Piecewise Attention Neural Tensor Network

Attention-Based Lstm With Filter Mechanism For Entity Relation Classification

A Bi-LSTM-RNN Model for Relation Classification Using Low-Cost Sequence Features

Relation Classification Via CNN, Segmented Max-pooling, and SDP-BLSTM.

Relation Classification Via Sequence Features and Bi-Directional LSTMs

Integrating Shortest Dependency Path and Sentence Sequence into a Deep Learning Framework for Relation Extraction in Clinical Text.

Relation Classification via Convolutional Deep Neural Network

Attention-Based Convolutional Neural Networks for Chinese Relation Extraction

Classifying Relations Via Long Short Term Memory Networks along Shortest Dependency Paths

Multi-Gram CNN-Based Self-Attention Model for Relation Classification

Classifying Relation via Piecewise Convolutional Neural Networks with Transfer Learning.

Bidirectional Gated Recurrent Unit Networks for Relation Classification with Multiple Attentions and Semantic Information