Abstract:Word embeddings that provide continuous low-dimensional vector representations of words have been extensively used for various natural language processing tasks. However, existing context-based word embeddings such as Word2vec and GloVe typically fail to capture sufficient sentiment information, which may result in words with similar vector representations having an opposite sentiment polarity e.g., good and bad, thus degrading sentiment analysis performance. To tackle this problem, recent studies have suggested learning sentiment embeddings to incorporate the sentiment polarity positive and negative information from labeled corpora. This study adopts another strategy to learn sentiment embeddings. Instead of creating a new word embedding from labeled corpora, we propose a word vector refinement model to refine existing pretrained word vectors using real-valued sentiment intensity scores provided by sentiment lexicons. The idea of the refinement model is to improve each word vector such that it can be closer in the lexicon to both semantically and sentimentally similar words i.e., those with similar intensity scores and further away from sentimentally dissimilar words i.e., those with dissimilar intensity scores. An obvious advantage of the proposed method is that it can be applied to any pretrained word embeddings. In addition, the intensity scores can provide more fine-grained real-valued sentiment information than binary polarity labels to guide the refinement process. Experimental results show that the proposed refinement model can improve both conventional word embeddings and previously proposed sentiment embeddings for binary, ternary, and fine-grained sentiment classification on the SemEval and Stanford Sentiment Treebank datasets.

Improving Twitter Sentiment Classification via Multi-Level Sentiment-Enriched Word Embeddings

Sentiment Lexicon Enhanced Neural Sentiment Classification

NNEMBs at SemEval-2017 Task 4: Neural Twitter Sentiment Classification: a Simple Ensemble Method with Different Embeddings.

User-level Sentiment Analysis Incorporating Social Networks

Construction Of Microblog-Specific Chinese Sentiment Lexicon Based On Representation Learning

Sentiment Commonsense Induced Sequential Neural Networks for Sentiment Classification.

A Multi-dimension and Multi-granularity Feature Fusion Method for Chinese Microblog Sentiment Classification

Word Embedding Composition for Data Imbalances in Sentiment and Emotion Classification

A comprehensive empirical analysis on cross-domain semantic enrichment for detection of depressive language

Improving Sentiment Analysis for Social Media Applications Using an Ensemble Deep Learning Language Model

Multi-feature fusion and dual-channel networks for sentiment analysis

Multi-source Data Fusion for Aspect-Level Sentiment Classification

MultiSentiNet: A Deep Semantic Network for Multimodal Sentiment Analysis

Sentiment Lexicon Enhanced Attention-Based LSTM for Sentiment Classification

Refining Word Embeddings Using Intensity Scores for Sentiment Analysis

Raw Tweets Emoji Tweets Word 2 Vec Sentence Representation Model Word Embeddings Representation Learning : Source Language Representation Learning : Target Language Labeled English Docs Supervised Learning Emoji Tweets Word 2 Vec Word EmbeddingsMachine Translate Classification Model

Cross-Domain Sentiment Encoding through Stochastic Word Embedding

Refined Global Word Embeddings Based on Sentiment Concept for Sentiment Analysis

Combining User-Based and Global Lexicon Features for Sentiment Analysis in Twitter

A Multi-sentiment-resource Enhanced Attention Network for Sentiment Classification

Sentiment Analysis Based on Heterogeneous Multi-Relation Signed Network