Abstract:With the explosion of online communication and publication, texts become obtainable via forums, chat messages, blogs, book reviews and movie reviews. Usually, these texts are much short and noisy without sufficient statistical signals and enough information for a good semantic analysis. Traditional natural language processing methods such as Bow-of-Word (BOW) based probabilistic latent semantic models fail to achieve high performance due to the short text environment. Recent researches have focused on the correlations between words, i.e., term dependencies, which could be helpful for mining latent semantics hidden in short texts and help people to understand them. Long short-term memory (LSTM) network can capture term dependencies and is able to remember the information for long periods of time. LSTM has been widely used and has obtained promising results in variants of problems of understanding latent semantics of texts. At the same time, by analyzing the texts, we find that a number of keywords contribute greatly to the semantics of the texts. In this paper, we establish a keyword vocabulary and propose an LSTM-based model that is sensitive to the words in the vocabulary; hence, the keywords leverage the semantics of the full document. The proposed model is evaluated in a short-text sentiment analysis task on two datasets: IMDB and SemEval-2016, respectively. Experimental results demonstrate that our model outperforms the baseline LSTM by 1%~2% in terms of accuracy and is effective with significant performance enhancement over several non-recurrent neural network latent semantic models (especially in dealing with short texts). We also incorporate the idea into a variant of LSTM named the gated recurrent unit (GRU) model and achieve good performance, which proves that our method is general enough to improve different deep learning models.

Sentiment Analysis of Weak-RuleText Based on the Combination of Sentiment Lexicon and Neural Network

Combining Vector Space Features and Convolution Neural Network for Text Sentiment Analysis.

Sentiment Analysis Of Text Based On Bidirectional Lstm With Multi-Head Attention

Combining Convolutional Neural Networks and Word Sentiment Sequence Features for Chinese Text Sentiment Classification

Chinese Comment Sentiment Analysis Method Based on Multi-Input Model and Syntactic Structure

Sentiment Lexicon Enhanced Neural Sentiment Classification

Sentiment Analysis of Weibo Comment Texts Based on Extended Vocabulary and Convolutional Neural Network.

Learning Word Sentiment with Neural Bag-Of-Words Model Combined with Ngram.

Research on Text Sentiment Analysis Based on Neural Network and Ensemble Learning

Chinese Implicit Sentiment Analysis based on Hybrid Neural Networks

Chinese Sentiment Analysis Using Bidirectional Lstm With Word Embedding

A Rule-Based Approach to Sentiment Classification of Chinese Microblogging Texts

A Sentiment Classification Method of Web Social Media Based on Multidimensional and Multilevel Modeling

Implicit sentiment analysis based on multi-feature neural network model

Emphasizing Essential Words for Sentiment Classification Based on Recurrent Neural Networks

Structural Information Aware Deep Semi-Supervised Recurrent Neural Network for Sentiment Analysis

Multi-modality Weakly Labeled Sentiment Learning Based on Explicit Emotion Signal for Chinese Microblog.

Sentiment Analysis of Comment Texts Based on BiLSTM.

Sentiment Analysis Based on Attention Mechanisms and Bi-Directional LSTM Fusion Model.

Analysis of Weibo sentiment with multi-dimensional features based on deep learning

Sentiment Analysis of Hybrid Network Model.