Abstract:In recent years, Aspect-based Sentiment Analysis (ABSA) has been a crucial yet challenging task in recognizing textual emotions from text. ABSA has numerous application across various fields, such as social media, commodity review, and movie comment, making it an attractive area of research. Many researchers are working to develop more powerful sentiment analysis models. Currently, most existing ABSA models use the generic pre-trained language models (PLMs) based fine-tuning paradigm, which only utilizes the encoder parameters while discarding the decoder parameters of PLMs. However, this approach fails to leverage the prior knowledge revealed in PLMs effectively. To address these issues, we investigate the potential of the initial pre-training scheme of PLMs to conduct ABSA and thus propose a novel approach in this paper, namely Target Word Transferred ABSA (WordTransABSA). In WordTransABSA, we propose "Word Transferred LM", a novel sequence-level optimization strategy that transferred target words in sentence into pivot tokens to stimulate better PLM semantic understanding capability. Given a sentence with aspect terms as input, WordTransABSA generates contextually appropriate semantics and predicts the affective tokens on the corresponding positions of the aspect terms. The final sentiment polarity of each aspect term is determined through several sentiment identification strategies that we selected. WordTransABSA takes full advantage of the versatile linguistic knowledge of Pre-trained Language Model, resulting in competitive accuracy compared with recent baselines. The WordTransABSA demonstrates its superiority and effectiveness through extensive experiments in both data-sufficient (full-data supervised learning) and data-insufficient (few-shot learning) scenarios. We have made our code publicly available on GitHub: https://github.com/albert-jin/WordTransABSA .

Aspect-Based Sentiment Analysis in Korean Based on Hierarchical Masking and Aspect-aware Attention

Exploiting Adaptive Contextual Masking for Aspect-Based Sentiment Analysis

Aspect-Based Sentiment Analysis of Specific Targets

An Interactive Multi-task Learning Model for Aspect-Based Sentiment Analysis.

Aspect-specific Parsimonious Segmentation Via Attention-Based Graph Convolutional Network for Aspect-based Sentiment Analysis

Hierarchical Fusion Network with Enhanced Knowledge and Contrastive Learning for Multimodal Aspect-Based Sentiment Analysis on Social Media

Effective inter-aspect words modeling for aspect-based sentiment analysis

Multi-Level Attentional Network for Aspect-based Sentiment Analysis

Hierarchical Human-Like Strategy for Aspect-Level Sentiment Classification with Sentiment Linguistic Knowledge and Reinforcement Learning.

A Hybrid Approach for Aspect-Based Sentiment Analysis Using Deep Contextual Word Embeddings and Hierarchical Attention

POS-ATAEPE-BiLSTM: an aspect-based sentiment analysis algorithm considering part-of-speech embedding

Aspect-Based Sentiment Analysis with New Target Representation and Dependency Attention

Learn to Select Via Hierarchical Gate Mechanism for Aspect-Based Sentiment Analysis.

WordTransABSA: Enhancing Aspect-based Sentiment Analysis with masked language modeling for affective token prediction

Hierarchical Attention Based Position-Aware Network for Aspect-Level Sentiment Analysis.

Aspect-based Sentiment Analysis Via Multitask Learning for Online Reviews

Targeted Aspect-Based Sentiment Analysis by Utilizing Dynamic Aspect Representation

Enhanced dual-level dependency parsing for aspect-based sentiment analysis

A Sparse Self-Attention Enhanced Model for Aspect-Level Sentiment Classification

Enhanced Aspect-Based Sentiment Analysis Models with Progressive Self-supervised Attention Learning

Memory network with hierarchical multi-head attention for aspect-based sentiment analysis