Supervised and Few-Shot Learning for Aspect-Based Sentiment Analysis of Instruction Prompt

Jie Huang,Yunpeng Cui,Juan Liu,Ming Liu

DOI: https://doi.org/10.3390/electronics13101924

IF: 2.9

2024-05-15

Electronics

Abstract:Aspect-based sentiment analysis (ABSA), which aims to extract aspects and corresponding opinions from sentences and determine aspect sentiment polarity, has been widely studied in recent years. Most approaches focus on the subtasks of ABSA and deal with them in the pipeline method or end-to-end method. However, these approaches ignore the semantic information of the labels and the correlation between the labels. In this study, we process various ABSA tasks in a unified generative framework and use instruction prompts to guide the generative model to learn the relationships between different sentiment elements, accurately identify the sentiment elements in sentences, and improve the performance of the model in few-shot learning. Experimental results on several benchmark datasets show that our approach achieves significant performance gains. Among them, for the aspect term extraction and sentiment classification task on the Laptop 14 dataset, our method improves the F1 score by 4.08% and 1.87% on fully supervised learning compared to the GAS model and PARA model, respectively. In few-shot learning, we can achieve 80% of the fully supervised learning performance using one-tenth of the dataset. Our method can effectively address the problem of data shortage in low-resource environments.

engineering, electrical & electronic,computer science, information systems,physics, applied

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper primarily addresses the following issues:

1. **Semantic Information and Correlation Between Different Labels**:
- Most existing methods for aspect-based sentiment analysis (ABSA) tasks ignore the semantic information and correlation between different labels. The authors attempt to solve this problem through a unified generative framework.

2. **Differences Between Pre-trained Models and Downstream Tasks**:
- The differences in training methods between pre-trained models and downstream tasks make it difficult to fully utilize the knowledge of pre-trained models. The paper proposes a method to reduce this gap and improve model performance.

3. **Data Scarcity in Low-Resource Environments**:
- In some domains, there is insufficient annotated data, making it difficult for traditional ABSA methods to achieve good results. The method proposed in this paper can still achieve good results with a small amount of data.

Specifically, the authors transform the ABSA task into a unified generative task and design three types of instruction prompts to improve the input and output formats, thereby better utilizing the knowledge of pre-trained models. Experimental results show that this method significantly improves model performance on several benchmark datasets and can achieve good results in few-shot learning scenarios.