Abstract:In recent years, Aspect-based Sentiment Analysis (ABSA) has been a crucial yet challenging task in recognizing textual emotions from text. ABSA has numerous application across various fields, such as social media, commodity review, and movie comment, making it an attractive area of research. Many researchers are working to develop more powerful sentiment analysis models. Currently, most existing ABSA models use the generic pre-trained language models (PLMs) based fine-tuning paradigm, which only utilizes the encoder parameters while discarding the decoder parameters of PLMs. However, this approach fails to leverage the prior knowledge revealed in PLMs effectively. To address these issues, we investigate the potential of the initial pre-training scheme of PLMs to conduct ABSA and thus propose a novel approach in this paper, namely Target Word Transferred ABSA (WordTransABSA). In WordTransABSA, we propose "Word Transferred LM", a novel sequence-level optimization strategy that transferred target words in sentence into pivot tokens to stimulate better PLM semantic understanding capability. Given a sentence with aspect terms as input, WordTransABSA generates contextually appropriate semantics and predicts the affective tokens on the corresponding positions of the aspect terms. The final sentiment polarity of each aspect term is determined through several sentiment identification strategies that we selected. WordTransABSA takes full advantage of the versatile linguistic knowledge of Pre-trained Language Model, resulting in competitive accuracy compared with recent baselines. The WordTransABSA demonstrates its superiority and effectiveness through extensive experiments in both data-sufficient (full-data supervised learning) and data-insufficient (few-shot learning) scenarios. We have made our code publicly available on GitHub: https://github.com/albert-jin/WordTransABSA .

POS-ATAEPE-BiLSTM: an aspect-based sentiment analysis algorithm considering part-of-speech embedding

An Interactive Multi-task Learning Model for Aspect-Based Sentiment Analysis.

WordTransABSA: Enhancing Aspect-based Sentiment Analysis with masked language modeling for affective token prediction

Position-based Contributive Embeddings for Aspect-Based Sentiment Analysis

A BERT-based multi-semantic learning model with aspect-aware enhancement for aspect polarity classification

SK2: Integrating Implicit Sentiment Knowledge and Explicit Syntax Knowledge for Aspect-Based Sentiment Analysis

Towards Unifying the Label Space for Aspect- and Sentence-based Sentiment Analysis

Improving Aspect-Based Sentiment Analysis Via Aligning Aspect Embedding

A syntactic features and interactive learning model for aspect-based sentiment analysis

Aspect-based Sentiment Analysis Via Multitask Learning for Online Reviews

Aspect-Based Sentiment Analysis with Explicit Sentiment Augmentations

A Multi-task Learning Model for Chinese-oriented Aspect Polarity Classification and Aspect Term Extraction

SISK: Integrating Aspect-oriented Semantic Information and Syntactic Knowledge for Aspect-based Sentiment Analysis

A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges

Aspect-to-Scope Oriented Multi-view Contrastive Learning for Aspect-based Sentiment Analysis

On the Robustness of Aspect-based Sentiment Analysis: Rethinking Model, Data, and Training

Targeted Aspect-Based Sentiment Analysis by Utilizing Dynamic Aspect Representation

Aspect-Based Sentiment Analysis of Specific Targets

Aspect-based Sentiment Analysis Via Fusing Multiple Sources of Textual Knowledge.

Flexibly utilizing syntactic knowledge in aspect-based sentiment analysis