Abstract:Textual representations play an important role in the field of natural language processing (NLP). The efficiency of NLP tasks, such as text comprehension and information extraction, can be significantly improved with proper textual representations. As neural networks are gradually applied to learn the representation of words and phrases, fairly efficient models of learning short text representations have been developed, such as the continuous bag of words (CBOW) and skip-gram models, and they have been extensively employed in a variety of NLP tasks. Because of the complex structure generated by the longer text lengths, such as sentences, algorithms appropriate for learning short textual representations are not applicable for learning long textual representations. One method of learning long textual representations is the Long Short-Term Memory (LSTM) network, which is suitable for processing sequences. However, the standard LSTM does not adequately address the primary sentence structure (subject, predicate and object), which is an important factor for producing appropriate sentence representations. To resolve this issue, this paper proposes the dependency-based LSTM model (D-LSTM). The D-LSTM divides a sentence representation into two parts: a basic component and a supporting component. The D-LSTM uses a pre-trained dependency parser to obtain the primary sentence information and generate supporting components, and it also uses a standard LSTM model to generate the basic sentence components. A weight factor that can adjust the ratio of the basic and supporting components in a sentence is introduced to generate the sentence representation. Compared with the representation learned by the standard LSTM, the sentence representation learned by the D-LSTM contains a greater amount of useful information. The experimental results show that the D-LSTM is superior to the standard LSTM for sentences involving compositional knowledge (SICK) data.

Gated Hierarchical LSTMs for Target-Based Sentiment Analysis.

Dependency-based Siamese Long Short-Term Memory Network for Learning Sentence Representations.

Utterance-Based Audio Sentiment Analysis Learned by a Parallel Combination of CNN and LSTM.

Audio Sentiment Analysis by Heterogeneous Signal Features Learned from Utterance-Based Parallel Neural Network.

Effective LSTMs for Target-Dependent Sentiment Classification

Attention Based LSTM for Target Dependent Sentiment Classification

Joint Learning for Targeted Sentiment Analysis.

Aspect Based Sentiment Analysis with Gated Convolutional Networks

An Attention-Aware Long Short-Term Memory-Like Spiking Neural Model for Sentiment Analysis

Sentiment classification using bidirectional LSTM-SNP model and attention mechanism

Sentiment Lexicon Enhanced Attention-Based LSTM for Sentiment Classification

Sentiment Commonsense Induced Sequential Neural Networks for Sentiment Classification.

Multimodal Sentiment Analysis with Word-Level Fusion and Reinforcement Learning

Sentiment analysis based on long short-term memory model

Attention-Based CNN and Bi-LSTM Model Based on TF-IDF and GloVe Word Embedding for Sentiment Analysis

Aspect-based sentiment analysis with alternating coattention networks

Attention-Based Modality-Gated Networks for Image-Text Sentiment Analysis

Learn to Select Via Hierarchical Gate Mechanism for Aspect-Based Sentiment Analysis.

Target-oriented Multimodal Sentiment Classification by Using Topic Model and Gating Mechanism.

TDAM: a Topic-Dependent Attention Model for Sentiment Analysis

GCAT-GTCU: Graph-Connected Attention Network and Gate Than Change Unit for Aspect-Level Sentiment Analysis