Abstract:Sentiment quantification is the task of training, by means of supervised learning, estimators of the relative frequency (also called ``prevalence'') of sentiment-related classes (such as \textsf{Positive}, \textsf{Neutral}, \textsf{Negative}) in a sample of unlabelled texts. This task is especially important when these texts are tweets, since the final goal of most sentiment classification efforts carried out on Twitter data is actually quantification (and not the classification of individual tweets). It is well-known that solving quantification by means of ``classify and count'' (i.e., by classifying all unlabelled items by means of a standard classifier and counting the items that have been assigned to a given class) is less than optimal in terms of accuracy, and that more accurate quantification methods exist. Gao and Sebastiani (2016) carried out a systematic comparison of quantification methods on the task of tweet sentiment quantification. In hindsight, we observe that the experimental protocol followed in that work was weak, and that the reliability of the conclusions that were drawn from the results is thus questionable. We now re-evaluate those quantification methods (plus a few more modern ones) on exactly the same same datasets, this time following a now consolidated and much more robust experimental protocol (which also involves simulating the presence, in the test data, of class prevalence values very different from those of the training set). This experimental protocol (even without counting the newly added methods) involves a number of experiments 5,775 times larger than that of the original study. The results of our experiments are dramatically different from those obtained by Gao and Sebastiani, and they provide a different, much more solid understanding of the relative strengths and weaknesses of different sentiment quantification methods.

A Recurrent Neural Network for Sentiment Quantification

Tweet Sentiment Quantification: An Experimental Re-Evaluation

A Relative Position Attention Network for Aspect-Based Sentiment Analysis

Cross-Lingual Sentiment Quantification

INSIGHT-1 at SemEval-2016 Task 4: Convolutional Neural Networks for Sentiment Classification and Quantification

Quantification using Permutation-Invariant Networks based on Histograms

An Effective Strategy for Sentiment Analysis Based on Complex-Valued Embedding and Quantum Long Short-Term Memory Neural Network

Expansion Quantization Network: An Efficient Micro-emotion Annotation and Detection Framework

Sentiment Commonsense Induced Sequential Neural Networks for Sentiment Classification.

Quantum Fuzzy Neural Network for multimodal sentiment and sarcasm detection

A semantic and syntactic enhanced neural model for financial sentiment analysis

A Survey of Quantum-Cognitively Inspired Sentiment Analysis Models

Quantum-inspired Interpretable Deep Learning Architecture for Text Sentiment Analysis

Document Modeling with Gated Recurrent Neural Network for Sentiment Classification.

Applying QNLP to sentiment analysis in finance

Sequential Multi-Kernel Convolutional Recurrent Network for Sentiment Classification

Linguistically Regularized LSTM for Sentiment Classification

Unified Framework for Quantification

SES-Net: A Novel Multi-Task Deep Neural Network Model for Analyzing E-learning Users' Satisfaction via Sentiment, Emotion, and Semantic

Encoding Syntactic Knowledge in Neural Networks for Sentiment Classification.

Tourism Review Sentiment Classification Using a Bidirectional Recurrent Neural Network with an Attention Mechanism and Topic-Enriched Word Vectors