Abstract:With the explosion of online communication and publication, texts become obtainable via forums, chat messages, blogs, book reviews and movie reviews. Usually, these texts are much short and noisy without sufficient statistical signals and enough information for a good semantic analysis. Traditional natural language processing methods such as Bow-of-Word (BOW) based probabilistic latent semantic models fail to achieve high performance due to the short text environment. Recent researches have focused on the correlations between words, i.e., term dependencies, which could be helpful for mining latent semantics hidden in short texts and help people to understand them. Long short-term memory (LSTM) network can capture term dependencies and is able to remember the information for long periods of time. LSTM has been widely used and has obtained promising results in variants of problems of understanding latent semantics of texts. At the same time, by analyzing the texts, we find that a number of keywords contribute greatly to the semantics of the texts. In this paper, we establish a keyword vocabulary and propose an LSTM-based model that is sensitive to the words in the vocabulary; hence, the keywords leverage the semantics of the full document. The proposed model is evaluated in a short-text sentiment analysis task on two datasets: IMDB and SemEval-2016, respectively. Experimental results demonstrate that our model outperforms the baseline LSTM by 1%~2% in terms of accuracy and is effective with significant performance enhancement over several non-recurrent neural network latent semantic models (especially in dealing with short texts). We also incorporate the idea into a variant of LSTM named the gated recurrent unit (GRU) model and achieve good performance, which proves that our method is general enough to improve different deep learning models.

Online News Emotion Prediction with Bidirectional LSTM

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Emphasizing Essential Words for Sentiment Classification Based on Recurrent Neural Networks

Text Sentiment Analysis Based on Convolutional Neural Network and Bidirectional LSTM Model.

Hierarchical Semantic Representations of Online News Comments for Emotion Tagging Using Multiple Information Sources

Jointly Trained Convolutional Neural Networks for Online News Emotion Analysis.

Towards building a social emotion detection system for online news.

Chinese Sentiment Analysis Using Bidirectional Lstm With Word Embedding

Social Emotion Prediction with Attention-based Hierarchical Neural Network

Attention-Based BiLSTM Network with Lexical Feature for Emotion Classification

A Deep Learning Framework for News Readers' Emotion Prediction Based on Features from News Article and Pseudo Comments.

Multi-Source Emotion Tagging for Online News Comments Using Bi-Directional Hierarchical Semantic Representation Model

Context-Aware Chinese Microblog Sentiment Classification With Bidirectional Lstm

Word Representation Learning Based on Bidirectional GRUs with Drop Loss for Sentiment Classification

Deep Sentiment Representation Based on CNN and LSTM

An LSTM Approach to Short Text Sentiment Classification with Word Embeddings.

CNN-SVM with Embedded Recurrent Structure for Social Emotion Prediction

Predicting Social Emotions from Readers’ Perspective

Sentiment analysis based on long short-term memory model

LSTM Based Semi-supervised Attention Framework for Sentiment Analysis

Document-Level Sentiment Analysis Using Attention-Based Bi-Directional Long Short-Term Memory Network and Two-Dimensional Convolutional Neural Network