Abstract:Aspect-based Sentiment Analysis (ABSA) aims to determine the sentiment polarity towards an aspect. Because of the expensive and limited labelled data, the pretraining strategy has become the de-facto standard for ABSA. However, there always exists severe domain shift between the pretraining and downstream ABSA datasets, hindering the effective knowledge transfer when directly finetuning and making the downstream task performs sub-optimal. To mitigate such domain shift, we introduce a unified alignment pretraining framework into the vanilla pretrain-finetune pipeline with both instance- and knowledge-level alignments. Specifically, we first devise a novel coarse-to-fine retrieval sampling approach to select target domain-related instances from the large-scale pretraining dataset, thus aligning the instances between pretraining and target domains (First Stage). Then, we introduce a knowledge guidance-based strategy to further bridge the domain gap at the knowledge level. In practice, we formulate the model pretrained on the sampled instances into a knowledge guidance model and a learner model, respectively. On the target dataset, we design an on-the-fly teacher-student joint fine-tuning approach to progressively transfer the knowledge from the knowledge guidance model to the learner model (Second Stage). Thereby, the learner model can maintain more domain-invariant knowledge when learning new knowledge from the target dataset. In the Third Stage, the learner model is finetuned to better adapt its learned knowledge to the target dataset. Extensive experiments and analyses on several ABSA benchmarks demonstrate the effectiveness and universality of our proposed pretraining framework. Our source code and models are publicly available at <a class="link-external link-https" href="https://github.com/WHU-ZQH/UIKA" rel="external noopener nofollow">this https URL</a>.

A Simple Yet Effective Framework for Few-Shot Aspect-Based Sentiment Analysis.

Self Question-answering - Aspect-based Sentiment Analysis by Role Flipped Machine Reading Comprehension.

Supervised and Few-Shot Learning for Aspect-Based Sentiment Analysis of Instruction Prompt

Towards Unifying the Label Space for Aspect- and Sentence-based Sentiment Analysis

A Weak Supervision Approach for Few-Shot Aspect Based Sentiment

SK2: Integrating Implicit Sentiment Knowledge and Explicit Syntax Knowledge for Aspect-Based Sentiment Analysis

DS$^2$-ABSA: Dual-Stream Data Synthesis with Label Refinement for Few-Shot Aspect-Based Sentiment Analysis

Unified Feature and Instance Based Domain Adaptation for Aspect-Based Sentiment Analysis

It is Simple Sometimes: A Study On Improving Aspect-Based Sentiment Analysis Performance

FMCF: Few-shot Multimodal Aspect-Based Sentiment Analysis Framework Based on Contrastive Finetuning

UnifiedABSA: A Unified ABSA Framework Based on Multi-task Instruction Tuning

Unified Instance and Knowledge Alignment Pretraining for Aspect-based Sentiment Analysis

A Simple Information-Based Approach to Unsupervised Domain-Adaptive Aspect-Based Sentiment Analysis

Unified ABSA Via Annotation-Decoupled Multi-task Instruction Tuning

Improving In-Context Learning Via Sequentially Selection and Preference Alignment for Few-Shot Aspect-Based Sentiment Analysis

POS-ATAEPE-BiLSTM: an aspect-based sentiment analysis algorithm considering part-of-speech embedding

A Unified Generative Framework for Aspect-Based Sentiment Analysis

Syntax-Guided Domain Adaptation for Aspect-based Sentiment Analysis

End-to-End Aspect-Based Sentiment Analysis Based on IDCNN-BLSA Feature Fusion

Few-shot Aspect Category Sentiment Analysis Via Meta-learning.

Is Compound Aspect-Based Sentiment Analysis Addressed by LLMs?