RVISA: Reasoning and Verification for Implicit Sentiment Analysis

Wenna Lai,Haoran Xie,Guandong Xu,Qing Li

2024-07-02

Abstract:With an increasing social demand for fine-grained sentiment analysis (SA), implicit sentiment analysis (ISA) poses a significant challenge with the absence of salient cue words in expressions. It necessitates reliable reasoning to understand how the sentiment is aroused and thus determine implicit sentiments. In the era of Large Language Models (LLMs), Encoder-Decoder (ED) LLMs have gained popularity to serve as backbone models for SA applications, considering impressive text comprehension and reasoning ability among diverse tasks. On the other hand, Decoder-only (DO) LLMs exhibit superior natural language generation and in-context learning capabilities. However, their responses may contain misleading or inaccurate information. To identify implicit sentiment with reliable reasoning, this study proposes RVISA, a two-stage reasoning framework that harnesses the generation ability of DO LLMs and the reasoning ability of ED LLMs to train an enhanced reasoner. Specifically, we adopt three-hop reasoning prompting to explicitly furnish sentiment elements as cues. The generated rationales are utilized to fine-tune an ED LLM into a skilled reasoner. Additionally, we develop a straightforward yet effective verification mechanism to ensure the reliability of the reasoning learning. We evaluated the proposed method on two benchmark datasets and achieved state-of-the-art results in ISA performance.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

The paper attempts to address the problem of how to identify and understand implicit sentiments in text through a reliable reasoning mechanism in Implicit Sentiment Analysis (ISA). Unlike explicit sentiment analysis, the challenge in implicit sentiment analysis lies in the lack of significant emotional markers in the expression, making it difficult for models to infer the true emotional inclination based solely on surface textual information. Therefore, a method is needed that can deeply understand and reason about the mechanisms behind the emotions in the text to accurately judge implicit sentiments.

The paper proposes a two-stage reasoning framework named RVISA (Reasoning and Verification for Implicit Sentiment Analysis), which aims to utilize the generative capabilities of generative models (such as decoder-only large language models DO LLMs) and the reasoning capabilities of reasoning models (such as encoder-decoder large language models ED LLMs) to train an enhanced reasoner. Specifically, RVISA provides emotional elements as clues through three-hop reasoning prompting, and the generated reasoning rationale is used to fine-tune ED LLMs, making them proficient reasoners. Additionally, a simple yet effective verification mechanism is developed to ensure the reliability of reasoning learning, achieving the best performance in implicit sentiment analysis on two benchmark datasets.