Abstract:Textual representations play an important role in the field of natural language processing (NLP). The efficiency of NLP tasks, such as text comprehension and information extraction, can be significantly improved with proper textual representations. As neural networks are gradually applied to learn the representation of words and phrases, fairly efficient models of learning short text representations have been developed, such as the continuous bag of words (CBOW) and skip-gram models, and they have been extensively employed in a variety of NLP tasks. Because of the complex structure generated by the longer text lengths, such as sentences, algorithms appropriate for learning short textual representations are not applicable for learning long textual representations. One method of learning long textual representations is the Long Short-Term Memory (LSTM) network, which is suitable for processing sequences. However, the standard LSTM does not adequately address the primary sentence structure (subject, predicate and object), which is an important factor for producing appropriate sentence representations. To resolve this issue, this paper proposes the dependency-based LSTM model (D-LSTM). The D-LSTM divides a sentence representation into two parts: a basic component and a supporting component. The D-LSTM uses a pre-trained dependency parser to obtain the primary sentence information and generate supporting components, and it also uses a standard LSTM model to generate the basic sentence components. A weight factor that can adjust the ratio of the basic and supporting components in a sentence is introduced to generate the sentence representation. Compared with the representation learned by the standard LSTM, the sentence representation learned by the D-LSTM contains a greater amount of useful information. The experimental results show that the D-LSTM is superior to the standard LSTM for sentences involving compositional knowledge (SICK) data.

LSTM-SN: complex text classifying with LSTM fusion social network

Dependency-based Siamese Long Short-Term Memory Network for Learning Sentence Representations.

Natural Language Inference Using Lstm Model With Sentence Fusion

An Attention-Based Multi-Representational Fusion Method for Social-Media-Based Text Classification

A C-LSTM Neural Network for Text Classification

Chinese text classification based on attention mechanism and feature-enhanced fusion neural network

Text classification of Chinese news based on multi-scale CNN and LSTM hybrid model

A text classification network model combining machine learning and deep learning

Sentiment Classification of Social Network Text Based on AT-BiLSTM Model in a Big Data Environment

Chinese Text Sentiment Classification Based on LSTM Word-Tag Relational Network Model

Link prediction based on feature representation and fusion

Three-Class Text Sentiment Analysis Based on LSTM

Sentiment classification using bidirectional LSTM-SNP model and attention mechanism

Densely Connected Bidirectional LSTM with Max-Pooling of CNN Network for Text Classification.

Long short-term memory (LSTM)-based news classification model

Combined CNN LSTM with attention for speech emotion recognition based on feature-level fusion

Emphasizing Essential Words for Sentiment Classification Based on Recurrent Neural Networks

Classification of hand movements from EEG using a FusionNet based LSTM network

Chinese Text Classification Based on Hybrid Model of CNN and LSTM

A Hierarchical Lstm Model with Multiple Features for Sentiment Analysis of Sina Weibo Texts