Abstract:Textual representations play an important role in the field of natural language processing (NLP). The efficiency of NLP tasks, such as text comprehension and information extraction, can be significantly improved with proper textual representations. As neural networks are gradually applied to learn the representation of words and phrases, fairly efficient models of learning short text representations have been developed, such as the continuous bag of words (CBOW) and skip-gram models, and they have been extensively employed in a variety of NLP tasks. Because of the complex structure generated by the longer text lengths, such as sentences, algorithms appropriate for learning short textual representations are not applicable for learning long textual representations. One method of learning long textual representations is the Long Short-Term Memory (LSTM) network, which is suitable for processing sequences. However, the standard LSTM does not adequately address the primary sentence structure (subject, predicate and object), which is an important factor for producing appropriate sentence representations. To resolve this issue, this paper proposes the dependency-based LSTM model (D-LSTM). The D-LSTM divides a sentence representation into two parts: a basic component and a supporting component. The D-LSTM uses a pre-trained dependency parser to obtain the primary sentence information and generate supporting components, and it also uses a standard LSTM model to generate the basic sentence components. A weight factor that can adjust the ratio of the basic and supporting components in a sentence is introduced to generate the sentence representation. Compared with the representation learned by the standard LSTM, the sentence representation learned by the D-LSTM contains a greater amount of useful information. The experimental results show that the D-LSTM is superior to the standard LSTM for sentences involving compositional knowledge (SICK) data.

Combining Context Dependency and Sentence Semantic Representation for Event Nugget Detection

Dependency-based Siamese Long Short-Term Memory Network for Learning Sentence Representations.

Event Detection Using a Self-Constructed Dependency and Graph Convolution Network

An Open-Domain Event Extraction Method Incorporating Semantic and Dependent Syntactic Information

Event detection from text using path-aware graph convolutional network

Event Detection with Multi-Order Edge-Aware Graph Convolution Networks

Edge-Enhanced Graph Convolution Networks for Event Detection with Syntactic Relation

FGCAN: Filter-based Gated Contextual Attention Network for event detection

MLBiNet: A Cross-Sentence Collective Event Detection Network

Event Extraction Via Dynamic Multi-Pooling Convolutional Neural Networks.

Dependency Multi-Weight-view Graphs for Event Detection with Label Co-Occurrence

Using Context Events in Neural Network Models for Event Temporal Status Identification

A Two-Stage Biomedical Event Trigger Detection Method Based on Hybrid Neural Network and Sentence Embeddings

Event Detection With Dynamic Word-Trigger-Argument Graph Neural Networks

Exploiting Contextual Information via Dynamic Memory Network for Event Detection

Continuous Similarity Learning with Shared Neural Semantic Representation for Joint Event Detection and Evolution

Dependency-based Convolutional Neural Networks for Sentence Embedding

Hybrid laparoendoscopic single-site (LESS) pyeloplasty: Initial experience in children.

ES-ESens: Detection of Event Sentences Based on Evaluation of the Explicitness and Significance of Information

Syntax grounded graph convolutional network for joint entity and event extraction

A Convolution BiLSTM Neural Network Model for Chinese Event Extraction