Abstract:In recent years, Aspect-based Sentiment Analysis (ABSA) has been a crucial yet challenging task in recognizing textual emotions from text. ABSA has numerous application across various fields, such as social media, commodity review, and movie comment, making it an attractive area of research. Many researchers are working to develop more powerful sentiment analysis models. Currently, most existing ABSA models use the generic pre-trained language models (PLMs) based fine-tuning paradigm, which only utilizes the encoder parameters while discarding the decoder parameters of PLMs. However, this approach fails to leverage the prior knowledge revealed in PLMs effectively. To address these issues, we investigate the potential of the initial pre-training scheme of PLMs to conduct ABSA and thus propose a novel approach in this paper, namely Target Word Transferred ABSA (WordTransABSA). In WordTransABSA, we propose "Word Transferred LM", a novel sequence-level optimization strategy that transferred target words in sentence into pivot tokens to stimulate better PLM semantic understanding capability. Given a sentence with aspect terms as input, WordTransABSA generates contextually appropriate semantics and predicts the affective tokens on the corresponding positions of the aspect terms. The final sentiment polarity of each aspect term is determined through several sentiment identification strategies that we selected. WordTransABSA takes full advantage of the versatile linguistic knowledge of Pre-trained Language Model, resulting in competitive accuracy compared with recent baselines. The WordTransABSA demonstrates its superiority and effectiveness through extensive experiments in both data-sufficient (full-data supervised learning) and data-insufficient (few-shot learning) scenarios. We have made our code publicly available on GitHub: https://github.com/albert-jin/WordTransABSA .

Let's Rectify Step by Step: Improving Aspect-based Sentiment Analysis with Diffusion Models

Aspect-invariant Sentiment Features Learning: Adversarial Multi-task Learning for Aspect-based Sentiment Analysis.

Aspect-Based Sentiment Analysis with Explicit Sentiment Augmentations

Enhancing Aspect-Based Sentiment Analysis with Supervised Contrastive Learning

On the Robustness of Aspect-based Sentiment Analysis: Rethinking Model, Data, and Training

Aspect-specific Parsimonious Segmentation Via Attention-Based Graph Convolutional Network for Aspect-based Sentiment Analysis

Aspect-based Sentiment Analysis Via Fusing Multiple Sources of Textual Knowledge.

An Interactive Multi-task Learning Model for Aspect-Based Sentiment Analysis.

A Unified Generative Framework for Aspect-Based Sentiment Analysis

A Contrastive Cross-Channel Data Augmentation Framework for Aspect-based Sentiment Analysis

End-to-End Aspect-Based Sentiment Analysis Based on IDCNN-BLSA Feature Fusion

A Novel Aspect-Guided Deep Transition Model for Aspect Based Sentiment Analysis

A Dependency Syntactic Knowledge Augmented Interactive Architecture for End-to-End Aspect-based Sentiment Analysis

WordTransABSA: Enhancing Aspect-based Sentiment Analysis with masked language modeling for affective token prediction

A Method of Sentiment Classification for Chinese Aspect Level Based on Information Fusion

Improving Aspect-Based Sentiment Analysis Via Aligning Aspect Embedding

Modeling Inter-Aspect Dependencies with a Non-temporal Mechanism for Aspect-Based Sentiment Analysis.

A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges

Enhanced Aspect-Based Sentiment Analysis Models with Progressive Self-supervised Attention Learning

A syntactic features and interactive learning model for aspect-based sentiment analysis