Abstract:With the explosion of online communication and publication, texts become obtainable via forums, chat messages, blogs, book reviews and movie reviews. Usually, these texts are much short and noisy without sufficient statistical signals and enough information for a good semantic analysis. Traditional natural language processing methods such as Bow-of-Word (BOW) based probabilistic latent semantic models fail to achieve high performance due to the short text environment. Recent researches have focused on the correlations between words, i.e., term dependencies, which could be helpful for mining latent semantics hidden in short texts and help people to understand them. Long short-term memory (LSTM) network can capture term dependencies and is able to remember the information for long periods of time. LSTM has been widely used and has obtained promising results in variants of problems of understanding latent semantics of texts. At the same time, by analyzing the texts, we find that a number of keywords contribute greatly to the semantics of the texts. In this paper, we establish a keyword vocabulary and propose an LSTM-based model that is sensitive to the words in the vocabulary; hence, the keywords leverage the semantics of the full document. The proposed model is evaluated in a short-text sentiment analysis task on two datasets: IMDB and SemEval-2016, respectively. Experimental results demonstrate that our model outperforms the baseline LSTM by 1%~2% in terms of accuracy and is effective with significant performance enhancement over several non-recurrent neural network latent semantic models (especially in dealing with short texts). We also incorporate the idea into a variant of LSTM named the gated recurrent unit (GRU) model and achieve good performance, which proves that our method is general enough to improve different deep learning models.

Sentiment Analysis Based on LSTM Architecture with Emoticon Attention.

Attention-Emotion-Enhanced Convolutional LSTM for Sentiment Analysis.

SEntiMoji: An Emoji-Powered Learning Approach for Sentiment Analysis in Software Engineering

Building Corpus with Emoticons for Sentiment Analysis.

Sentiment Analysis of Microblogs with Rich Emoticons.

Emoji-Based Sentiment Analysis Using Attention Networks

Twitter Sentiment Analysis via Bi-sense Emoji Embedding and Attention-based LSTM

Microblog Sentiment Analysis with Emoticon Space Model

Sentiment Analysis Based on Attention Mechanisms and Bi-Directional LSTM Fusion Model.

Attention-Based BiLSTM Network with Lexical Feature for Emotion Classification

LSTM Based Semi-supervised Attention Framework for Sentiment Analysis

Research on Sentiment Analysis Based on BERT-LSTM Model

Sentiment Analysis Based on Hybrid Bi-attention Mechanism in Mobile Application

Emphasizing Essential Words for Sentiment Classification Based on Recurrent Neural Networks

Emoticon-Based Emotion Analysis for Weibo Articles in Sentence Level.

A Joint Learning Sentiment Analysis Method Incorporating Emoji-Augmentation

Improving Sentiment Analysis Accuracy with Emoji Embedding

Research on Image-text Multimodal Emotions Analysis with Fused Emoji

A Deep Learning Model Enhanced with Emotion Semantics for Microblog Sentiment Analysis

Emoticon Smoothed Language Models for Twitter Sentiment Analysis

Three-Class Text Sentiment Analysis Based on LSTM