Abstract:Sentiment lexicon is a very important resource for opinion mining. Recently, many state-of-the-art works employ deep learning techniques to construct sentiment lexicons. In general, they firstly learn sentiment-aware word embeddings, and then use it as word features to construct sentiment lexicons. However, these methods do not consider the importance of each word to the distinguish of documents' sentiment polarities. As we know, most words among a document do not contribute to understand documents' semantic or sentiment. For example, in the tweet It's a good day, but i can't feel it. I'm really unhappy. The words `unhappy', `feel' and `can't' are much more important than the words `good', `day' in predicting the sentiment polarity of this twitter. Meanwhile, many words, such as `the', `in', `it' and `I'm' are uninformative. In this paper, we propose a novel sparse self-attention LSTM (SSALSTM) to efficiently capture the above intuitive facts, and then construct a large scale sentiment lexicons in twitter. In SSALSTM, we use a novel self-attention mechanism to capture the importance of each words to the distinguish of documents' sentiment polarities. In addition, a $L_1$ regularize is applied in the attentions which can ensure the sparsity characters that most words in a document are semantic and sentiment indistinguishable. Once we learn an efficient sentiment-aware word embedding, we train a classifier which uses sentiment-aware word embedding as features to predict the sentiment polarities of words. Extensive experiments on four publicly available datasets, SemEval 2013-2016, indicate that the sentiment lexicon generated by our proposed model achieves state-of-the-art performance on both supervised and unsupervised sentiment classification tasks.

Two-Level LSTM for Sentiment Analysis with Lexicon Embedding and Polar Flipping

$\rho$-hot Lexicon Embedding-based Two-level LSTM for Sentiment Analysis

$ρ$-hot Lexicon Embedding-based Two-level LSTM for Sentiment Analysis

Lexicon-Enhanced LSTM with Attention for General Sentiment Analysis.

Automatic Construction and Global Optimization of a Multisentiment Lexicon.

Automatic Construction and Optimization of Sentiment Lexicon Based on Word2Vec

Building Sentiment Lexicon with Representation Learning Based on Contrast and Label of Sentiment

User reviews: Sentiment analysis using lexicon integrated two-channel CNN–LSTM family models

A Novel Sentiment Polarity Detection Framework for Chinese

Combining Convolutional Neural Networks and Word Sentiment Sequence Features for Chinese Text Sentiment Classification

A method of constructing a fine-grained sentiment lexicon for the humanities computing of classical chinese poetry

Sentiment Lexicon Enhanced Neural Sentiment Classification

An LSTM Approach to Short Text Sentiment Classification with Word Embeddings.

Chinese Sentiment Analysis Using Bidirectional Lstm With Word Embedding

A Two-Level Classifier Model for Sentiment Analysis.

SENTIMENT CLASSIFICATION FOR CHINESE MICROBLOGGING BASED ON POLARITY LEXICONS

Sentiment Lexical-Augmented Convolutional Neural Networks for Sentiment Analysis.

Sentiment Analysis With Automatically Constructed Lexicon And Three-Way Decision

Text multi-label sentiment analysis based on Bi-LSTM

Sentiment Lexicon Embedding Based on Radical and Phoneme

Sparse Self-Attention LSTM for Sentiment Lexicon Construction.