Chain of Empathy: Enhancing Empathetic Response of Large Language Models Based on Psychotherapy Models

Yoon Kyung Lee,Inju Lee,Minjung Shin,Seoyeon Bae,Sowon Hahn
DOI: https://doi.org/10.19066/cogsci.2024.35.1.002
2024-09-14
Abstract:We present a novel method, the Chain of Empathy (CoE) prompting, that utilizes insights from psychotherapy to induce Large Language Models (LLMs) to reason about human emotional states. This method is inspired by various psychotherapy approaches including Cognitive Behavioral Therapy (CBT), Dialectical Behavior Therapy (DBT), Person Centered Therapy (PCT), and Reality Therapy (RT), each leading to different patterns of interpreting clients' mental states. LLMs without reasoning generated predominantly exploratory responses. However, when LLMs used CoE reasoning, we found a more comprehensive range of empathetic responses aligned with the different reasoning patterns of each psychotherapy model. The CBT based CoE resulted in the most balanced generation of empathetic responses. The findings underscore the importance of understanding the emotional context and how it affects human and AI communication. Our research contributes to understanding how psychotherapeutic models can be incorporated into LLMs, facilitating the development of context-specific, safer, and empathetic AI.
Computation and Language,Artificial Intelligence,Human-Computer Interaction
What problem does this paper attempt to address?
The paper attempts to address the issue of how to enhance the ability of large language models (LLMs) to generate empathetic responses by introducing psychotherapy models. Specifically, the researchers propose a new method—Chain of Empathy (CoE) prompting, which leverages insights from cognitive behavioral therapy (CBT), dialectical behavior therapy (DBT), person-centered therapy (PCT), and reality therapy (RT) to enable LLMs to better understand and respond to human emotional states. ### Main Issues: 1. **How to make LLMs generate more empathetic responses**: Existing LLMs often lack a deep understanding and expression of emotional states when generating text, resulting in responses that appear generic and unnatural. The researchers aim to introduce reasoning processes from psychotherapy models to enable LLMs to generate more specific, contextualized empathetic responses. 2. **The impact of different psychotherapy models on empathetic responses**: Different psychotherapy models have different reasoning approaches and goals. The researchers aim to explore how these different models affect the type and quality of empathetic responses generated by LLMs. 3. **The effect of empathetic reasoning on responses to user input**: The researchers also aim to experimentally verify whether introducing empathetic reasoning can significantly improve the empathetic expression of LLMs when processing user input. ### Solution: - **Chain of Empathy (CoE) Prompting**: This is a new prompting method that introduces a reasoning step before generating text, allowing LLMs to better understand the user's emotional state and contextual factors. Specifically, CoE prompting includes the following steps: 1. Identifying words in the user's message that represent emotions. 2. Understanding the individual or contextual factors leading to the user's emotional expression. - **Experimental Design**: The researchers used the GPT-3.5 model and designed four CoE prompting conditions based on different psychotherapy models (CBT-CoE, DBT-CoE, PCT-CoE, RT-CoE), as well as a baseline condition without reasoning. By comparing the model performance under different conditions, they evaluated the effectiveness of CoE prompting. ### Experimental Results: - **Model Performance**: The study found that all models using CoE prompting exhibited higher diversity and accuracy in generating empathetic responses, with the CBT-CoE model performing best in generating explanatory strategies. - **User Perception**: Although the experiment mainly focused on the accuracy of the empathetic responses generated by the models, the researchers also noted that future research needs to further evaluate user perceptions and reactions to these empathetic responses. ### Conclusion: Introducing empathetic reasoning processes from psychotherapy models can significantly improve the performance of LLMs in generating empathetic responses. The CBT-CoE model, in particular, excelled in generating explanatory strategies, which may reflect the unique advantage of the CBT model in clarifying cognitive errors. These findings highlight the importance of incorporating context-specific empathetic reasoning in human-computer interactions.