Abstract:In aspect-based sentiment analysis (ABSA), many neural models are equipped with an attention mechanism to quantify the contribution of each context word to sentiment prediction. However, such a mechanism suffers from one drawback: only a few frequent words with sentiment polarities are tended to be taken into consideration for final sentiment decision while abundant infrequent sentiment words are ignored by models. To deal with this issue, we propose a progressive self-supervised attention learning approach for attentional ABSA models. In this approach, we iteratively perform sentiment prediction on all training instances, and continually learn useful attention supervision information in the meantime. During training, at each iteration, context words with the highest impact on sentiment prediction, identified based on their attention weights or gradients, are extracted as words with active/misleading influence on the correct/incorrect prediction for each instance. Words extracted in this way are masked for subsequent iterations. To exploit these extracted words for refining ABSA models, we augment the conventional training objective with a regularization term that encourages ABSA models to not only take full advantage of the extracted active context words but also decrease the weights of those misleading words. We integrate the proposed approach into three state-of-the-art neural ABSA models. Experiment results and in-depth analyses show that our approach yields better attention results and significantly enhances the performance of all three models. We release the source code and trained models at <a class="link-external link-https" href="https://github.com/DeepLearnXMU/PSSAttention" rel="external noopener nofollow">this https URL</a>.

Improving In-Context Learning Via Sequentially Selection and Preference Alignment for Few-Shot Aspect-Based Sentiment Analysis

A Simple Yet Effective Framework for Few-Shot Aspect-Based Sentiment Analysis.

Supervised and Few-Shot Learning for Aspect-Based Sentiment Analysis of Instruction Prompt

DS$^2$-ABSA: Dual-Stream Data Synthesis with Label Refinement for Few-Shot Aspect-Based Sentiment Analysis

A Weak Supervision Approach for Few-Shot Aspect Based Sentiment

Multi-Label Few-Shot Learning for Aspect Category Detection

Aspect-Pair Supervised Contrastive Learning for aspect-based sentiment analysis

Aspect-invariant Sentiment Features Learning: Adversarial Multi-task Learning for Aspect-based Sentiment Analysis.

Enhancing Aspect-Based Sentiment Analysis with Supervised Contrastive Learning

Metric-Free Learning Network with Dual Relations Propagation for Few-Shot Aspect Category Sentiment Analysis

Few-shot Aspect Category Sentiment Analysis Via Meta-learning.

Aspect-to-Scope Oriented Multi-view Contrastive Learning for Aspect-based Sentiment Analysis

A Contrastive Learning Framework with Tree-LSTMs for Aspect-Based Sentiment Analysis

Aspect-Specific Context Modeling for Aspect-Based Sentiment Analysis

Learning to Detect Opinion Snippet for Aspect-Based Sentiment Analysis

An Interactive Multi-task Learning Model for Aspect-Based Sentiment Analysis.

Instruction Tuning with Retrieval-based Examples Ranking for Aspect-based Sentiment Analysis

A Contrastive Cross-Channel Data Augmentation Framework for Aspect-based Sentiment Analysis

Enhanced Aspect-Based Sentiment Analysis Models with Progressive Self-supervised Attention Learning

Boosting Large Language Models with Continual Learning for Aspect-based Sentiment Analysis

Modeling Inter-Aspect Dependencies with a Non-temporal Mechanism for Aspect-Based Sentiment Analysis.