Enhancing Large Language Model with Decomposed Reasoning for Emotion Cause Pair Extraction

Jialiang Wu,Yi Shen,Ziheng Zhang,Longjun Cai
2024-01-31
Abstract:Emotion-Cause Pair Extraction (ECPE) involves extracting clause pairs representing emotions and their causes in a document. Existing methods tend to overfit spurious correlations, such as positional bias in existing benchmark datasets, rather than capturing semantic features. Inspired by recent work, we explore leveraging large language model (LLM) to address ECPE task without additional training. Despite strong capabilities, LLMs suffer from uncontrollable outputs, resulting in mediocre performance. To address this, we introduce chain-of-thought to mimic human cognitive process and propose the Decomposed Emotion-Cause Chain (DECC) framework. Combining inducing inference and logical pruning, DECC guides LLMs to tackle ECPE task. We further enhance the framework by incorporating in-context learning. Experiment results demonstrate the strength of DECC compared to state-of-the-art supervised fine-tuning methods. Finally, we analyze the effectiveness of each component and the robustness of the method in various scenarios, including different LLM bases, rebalanced datasets, and multi-pair extraction.
Computation and Language
What problem does this paper attempt to address?
The problem that this paper attempts to solve is that in the Emotion - Cause Pair Extraction (ECPE) task, existing methods are often over - fitted to the position bias in the dataset rather than truly capturing semantic features. Specifically, when dealing with the ECPE task, many existing methods are easily influenced by the position information where emotions and their causes usually appear adjacently in the dataset, resulting in the model being sensitive to the data distribution and lacking robustness. In addition, when directly using large - language models (LLMs) for information extraction, although a high recall rate can be achieved, the precision is low and it is difficult to control the output, leading to mediocre performance. To solve these problems, the paper proposes a framework based on decomposed reasoning - the Decomposed Emotion - Cause Chain (DECC) - to use LLMs to complete the ECPE task. The DECC framework, by introducing the chain - of - thought (COT) technique, imitates the human cognitive process, combines abductive reasoning and logical pruning, and guides LLMs to solve the ECPE task step by step. In addition, DECC also combines in - context learning (ICL) to further improve the performance of the model. Through this method, the paper aims to improve the precision and robustness of the ECPE task, reduce the dependence on the position bias in the dataset, and effectively handle the extraction problem of multiple emotion - cause pairs. Experimental results show that the performance of the DECC framework on different benchmark datasets is better than that of existing supervised fine - tuning methods, and it performs excellently when dealing with re - balanced datasets, showing its good generalization ability.