Abstract:Large language models (LLMs) have achieved promising results in sentiment analysis through the in-context learning (ICL) paradigm. However, their ability to distinguish subtle sentiments still remains a challenge. Inspired by the human ability to adjust understanding via feedback, this paper enhances ICL by incorporating prior predictions and feedback, aiming to rectify sentiment misinterpretation of LLMs. Specifically, the proposed framework consists of three steps: (1) acquiring prior predictions of LLMs, (2) devising predictive feedback based on correctness, and (3) leveraging a feedback-driven prompt to refine sentiment understanding. Experimental results across nine sentiment analysis datasets demonstrate the superiority of our framework over conventional ICL methods, with an average F1 improvement of 5.95%.

What problem does this paper attempt to address?

The problem this paper attempts to address is that while large language models (LLMs) have achieved significant results in sentiment analysis tasks through the in-context learning (ICL) paradigm, they still struggle to effectively distinguish subtle similar sentiments. Specifically, LLMs are prone to misjudgments when dealing with fine-grained sentiment differences, such as misclassifying neutral sentiments into other categories or confusing similar but not identical sentiment labels in fine-grained sentiment recognition. To address this issue, the paper proposes an enhanced ICL framework that introduces a prediction feedback mechanism to correct the sentiment understanding biases of LLMs. The main contributions of the paper include: 1. **Introduction of Prediction Feedback**: By obtaining prior predictions of LLMs on candidate examples and designing feedback based on the correctness of the predictions, the model is helped to adjust its sentiment understanding. 2. **Three-Step Framework**: - **Prior Prediction Acquisition**: Using traditional ICL methods to make initial predictions for each candidate example. - **Prediction Feedback Design**: Dividing examples into correct and incorrect sub-pools based on the correctness of the predictions and providing feedback in natural language form. - **Test Sample Inference**: During the inference phase, selecting relevant examples from each sub-pool and using specific feedback-driven prompts to improve sentiment understanding. 3. **Experimental Validation**: Experiments were conducted on 9 sentiment analysis datasets, and the results showed that this framework improved the average F1 score by 5.95% compared to traditional ICL methods. Through these methods, the paper aims to improve the performance of LLMs in sentiment analysis tasks, particularly in the accuracy of handling subtle sentiment differences.

Improving In-Context Learning with Prediction Feedback for Sentiment Analysis

Investigating the Learning Behaviour of In-Context Learning: A Comparison with Supervised Learning

Towards Understanding In-Context Learning with Contrastive Demonstrations and Saliency Maps

Incorporating conditional random fields and active learning to improve sentiment identification.

A Survey on In-context Learning

Sentiment Analysis through LLM Negotiations

Training Language Models with Language Feedback at Scale

Does In-Context Learning Really Learn? Rethinking How Large Language Models Respond and Solve Tasks via In-Context Learning

Improving LLM-Based Health Information Extraction with In-Context Learning

2014 Special Issue: Incorporating conditional random fields and active learning to improve sentiment identification

The Mystery of In-Context Learning: A Comprehensive Survey on Interpretation and Analysis

Improving Contrastive Learning of Sentence Embeddings from AI Feedback

Language Model Self-improvement by Reinforcement Learning Contemplation

Improving In-Context Learning Via Sequentially Selection and Preference Alignment for Few-Shot Aspect-Based Sentiment Analysis

C-ICL: Contrastive In-context Learning for Information Extraction

Let's Learn Step by Step: Enhancing In-Context Learning Ability with Curriculum Learning

Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Models

Aligning LLMs with Human Instructions and Stock Market Feedback in Financial Sentiment Analysis

Instruction Tuning Vs. In-Context Learning: Revisiting Large Language Models in Few-Shot Computational Social Science

Context-faithful Prompting for Large Language Models