Abstract:In recent years, several online platforms have seen a rapid increase in the number of review systems that request users to provide aspect-level feedback. Document-level Multi-aspect Sentiment Classification (DMSC), where the goal is to predict the ratings/sentiment from a review at an individual aspect level, has become a challenging and imminent problem. To tackle this challenge, we propose a deliberate self-attention-based deep neural network model, namely FEDAR, for the DMSC problem, which can achieve competitive performance while also being able to interpret the predictions made. FEDAR is equipped with a highway word embedding layer to transfer knowledge from pre-trained word embeddings, an RNN encoder layer with output features enriched by pooling and factorization techniques, and a deliberate self-attention layer. In addition, we also propose an Attention-driven Keywords Ranking (AKR) method, which can automatically discover aspect keywords and aspect-level opinion keywords from the review corpus based on the attention weights. These keywords are significant for rating predictions by FEDAR. Since crowdsourcing annotation can be an alternate way to recover missing ratings of reviews, we propose a LEcture-AuDience (LEAD) strategy to estimate model uncertainty in the context of multi-task learning, so that valuable human resources can focus on the most uncertain predictions. Our extensive set of experiments on five different open-domain DMSC datasets demonstrate the superiority of the proposed FEDAR and LEAD models. We further introduce two new DMSC datasets in the healthcare domain and benchmark different baseline models and our models on them. Attention weights visualization results and visualization of aspect and opinion keywords demonstrate the interpretability of our model and the effectiveness of our AKR method.

Making Decision Like Human: Joint Aspect Category Sentiment Analysis and Rating Prediction with Fine-to-Coarse Reasoning

ASAP: A Chinese Review Dataset Towards Aspect Category Sentiment Analysis and Rating Prediction

Modeling Category Semantic and Sentiment Knowledge for Aspect-Level Sentiment Analysis

Modeling Adaptive Inter-Task Feature Interactions Via Sentiment-Aware Contrastive Learning for Joint Aspect-Sentiment Prediction

Joint Multi-modal Aspect-Sentiment Analysis with Auxiliary Cross-modal Relation Detection.

Jointly Modeling Review Content and Aspect Ratings for Review Rating Prediction

Aspect-oriented Opinion Alignment Network for Aspect-Based Sentiment Classification

A Hierarchical Interactive Network for Joint Span-based Aspect-Sentiment Analysis

Hierarchical Human-Like Strategy for Aspect-Level Sentiment Classification with Sentiment Linguistic Knowledge and Reinforcement Learning.

Human-Like Decision Making: Document-level Aspect Sentiment Classification Via Hierarchical Reinforcement Learning

Joint Multimodal Aspect Sentiment Analysis with Aspect Enhancement and Syntactic Adaptive Learning

Few-shot Aspect Category Sentiment Analysis Via Meta-learning.

Aspect term extraction via adaptive fusion of sequential and hierarchical representation

Aspect-based Sentiment Analysis Via Multitask Learning for Online Reviews

Aspect Category Sentiment Analysis Based on Prompt-Based Learning with Attention Mechanism

Aspect-invariant Sentiment Features Learning: Adversarial Multi-task Learning for Aspect-based Sentiment Analysis.

Attention-based Sentiment Reasoner for Aspect-Based Sentiment Analysis.

An Interactive Multi-task Learning Model for Aspect-Based Sentiment Analysis.

Aspect Category Sentiment Analysis with Self-Attention Fusion Networks

An Interpretable and Uncertainty Aware Multi-Task Framework for Multi-Aspect Sentiment Analysis

Ratable Aspects over Sentiments: Predicting Ratings for Unrated Reviews