Abstract:With the explosion of online communication and publication, texts become obtainable via forums, chat messages, blogs, book reviews and movie reviews. Usually, these texts are much short and noisy without sufficient statistical signals and enough information for a good semantic analysis. Traditional natural language processing methods such as Bow-of-Word (BOW) based probabilistic latent semantic models fail to achieve high performance due to the short text environment. Recent researches have focused on the correlations between words, i.e., term dependencies, which could be helpful for mining latent semantics hidden in short texts and help people to understand them. Long short-term memory (LSTM) network can capture term dependencies and is able to remember the information for long periods of time. LSTM has been widely used and has obtained promising results in variants of problems of understanding latent semantics of texts. At the same time, by analyzing the texts, we find that a number of keywords contribute greatly to the semantics of the texts. In this paper, we establish a keyword vocabulary and propose an LSTM-based model that is sensitive to the words in the vocabulary; hence, the keywords leverage the semantics of the full document. The proposed model is evaluated in a short-text sentiment analysis task on two datasets: IMDB and SemEval-2016, respectively. Experimental results demonstrate that our model outperforms the baseline LSTM by 1%~2% in terms of accuracy and is effective with significant performance enhancement over several non-recurrent neural network latent semantic models (especially in dealing with short texts). We also incorporate the idea into a variant of LSTM named the gated recurrent unit (GRU) model and achieve good performance, which proves that our method is general enough to improve different deep learning models.

Chinese Text Sentiment Classification Based on LSTM Word-Tag Relational Network Model

Deep Sentiment Representation Based on CNN and LSTM

A Deep Neural Network Approach using Convolutional Network and Long Short Term Memory for Text Sentiment Classification

Text Sentiment Analysis Based on Convolutional Neural Network and Bidirectional LSTM Model.

Chinese Text Classification Based on Hybrid Model of CNN and LSTM

Chinese Text Classification Model Based on Deep Learning

Chinese Sentiment Analysis Using Bidirectional Lstm With Word Embedding

A P-LSTM Neural Network for Sentiment Classification.

Emphasizing Essential Words for Sentiment Classification Based on Recurrent Neural Networks

Sentiment analysis based on long short-term memory model

Combining Vector Space Features and Convolution Neural Network for Text Sentiment Analysis.

Sentiment Analysis of Chinese Text Based on CNN-BiLSTM Serial Hybrid Model.

Chinese Text Sentiment Classification by H-RNN-CNN

A Deep Neural Network Model for Target-based Sentiment Analysis.

A C-LSTM Neural Network for Text Classification

An LSTM Approach to Short Text Sentiment Classification with Word Embeddings.

A C-LSTM with Word Embedding Model for News Text Classification

Text multi-label sentiment analysis based on Bi-LSTM

A Unified Tagging Solution: Bidirectional LSTM Recurrent Neural Network with Word Embedding.

Deep ConvRNN for Sentiment Parsing of Chinese Microblogging Texts