Abstract:Sentiment lexicon is a very important resource for opinion mining. Recently, many state-of-the-art works employ deep learning techniques to construct sentiment lexicons. In general, they firstly learn sentiment-aware word embeddings, and then use it as word features to construct sentiment lexicons. However, these methods do not consider the importance of each word to the distinguish of documents' sentiment polarities. As we know, most words among a document do not contribute to understand documents' semantic or sentiment. For example, in the tweet It's a good day, but i can't feel it. I'm really unhappy. The words `unhappy', `feel' and `can't' are much more important than the words `good', `day' in predicting the sentiment polarity of this twitter. Meanwhile, many words, such as `the', `in', `it' and `I'm' are uninformative. In this paper, we propose a novel sparse self-attention LSTM (SSALSTM) to efficiently capture the above intuitive facts, and then construct a large scale sentiment lexicons in twitter. In SSALSTM, we use a novel self-attention mechanism to capture the importance of each words to the distinguish of documents' sentiment polarities. In addition, a $L_1$ regularize is applied in the attentions which can ensure the sparsity characters that most words in a document are semantic and sentiment indistinguishable. Once we learn an efficient sentiment-aware word embedding, we train a classifier which uses sentiment-aware word embedding as features to predict the sentiment polarities of words. Extensive experiments on four publicly available datasets, SemEval 2013-2016, indicate that the sentiment lexicon generated by our proposed model achieves state-of-the-art performance on both supervised and unsupervised sentiment classification tasks.

Identification of Sentiment Labels Based on Self-training

Self-training Strategies for Sentiment Analysis: An Empirical Study

Label-Efficient Emotion and Sentiment Analysis

SEntiMoji: An Emoji-Powered Learning Approach for Sentiment Analysis in Software Engineering

LaSSL: Label-Guided Self-Training for Semi-supervised Learning

Exploring The Contribution of Unlabeled Data in Financial Sentiment Analysis

Reserved Self-training: A Semi-supervised Sentiment Classification Method for Chinese Microblogs.

Cooperative Hybrid Semi-Supervised Learning For Text Sentiment Classification

Interpretability in Sentiment Analysis: A Self-Supervised Approach to Sentiment Cue Extraction

Self-Training with Pseudo-Label Scorer for Aspect Sentiment Quad Prediction

Toward Label-Efficient Emotion and Sentiment Analysis

Remote Sensing Image Scene Classification with Self-Supervised Paradigm under Limited Labeled Samples

Semi-supervised Sentiment Classification Based on Auxiliary Task Learning.

Sparse Self-Attention LSTM for Sentiment Lexicon Construction.

SECT: Sentiment-Enriched Continual Training for Image Sentiment Analysis.

Sentiment Analysis With Automatically Constructed Lexicon And Three-Way Decision

Sentiment Knowledge Enhanced Self-supervised Learning for Multimodal Sentiment Analysis.

Iself: Towards Cold-Start Emotion Labeling Using Transfer Learning With Smartphones

Sentiment Classification Using Subjective and Objective Views

Incorporating conditional random fields and active learning to improve sentiment identification.

Co-training for Cross-Lingual Sentiment Classification