Abstract:Online peer-to-peer support platforms enable conversations between millions of people who seek and provide mental health support. If successful, web-based mental health conversations could improve access to treatment and reduce the global disease burden. Psychologists have repeatedly demonstrated that empathy, the ability to understand and feel the emotions and experiences of others, is a key component leading to positive outcomes in supportive conversations. However, recent studies have shown that highly empathic conversations are rare in online mental health platforms. In this paper, we work towards improving empathy in online mental health support conversations. We introduce a new task of empathic rewriting which aims to transform low-empathy conversational posts to higher empathy. Learning such transformations is challenging and requires a deep understanding of empathy while maintaining conversation quality through text fluency and specificity to the conversational context. Here we propose PARTNER, a deep reinforcement learning agent that learns to make sentence-level edits to posts in order to increase the expressed level of empathy while maintaining conversation quality. Our RL agent leverages a policy network, based on a transformer language model adapted from GPT-2, which performs the dual task of generating candidate empathic sentences and adding those sentences at appropriate positions. During training, we reward transformations that increase empathy in posts while maintaining text fluency, context specificity and diversity. Through a combination of automatic and human evaluation, we demonstrate that PARTNER successfully generates more empathic, specific, and diverse responses and outperforms NLP methods from related tasks like style transfer and empathic dialogue generation. Our work has direct implications for facilitating empathic conversations on web-based platforms.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to improve the level of empathy in conversations on online mental health support platforms. Specifically, the paper points out that although psychologists have proven that empathy is a key factor in promoting positive outcomes in supportive conversations, highly empathetic conversations on online mental health support platforms are rare. To improve this situation, the paper introduces a new task - "Empathic Rewriting", whose goal is to transform low - empathy conversations into high - empathy ones. This involves modifying existing conversations to increase the degree of expressed empathy while maintaining the quality of the conversation, including language fluency, context - relevance and diversity. The paper achieves this goal by proposing an agent model "Partner" based on Deep Reinforcement Learning (DRL). Partner can identify the parts in the conversation that need improvement and generate or replace more empathetic sentences, thereby enhancing the level of empathy in the conversation without compromising the quality of the conversation. This research has a direct significance for improving the effectiveness of online mental health support platforms and is helpful for improving the communication quality between supporters and seekers on these platforms.

Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approach

A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Support

Human-AI Collaboration Enables More Empathic Conversations in Text-based Peer-to-Peer Mental Health Support

Empathy Level Alignment via Reinforcement Learning for Empathetic Response Generation

Emotion-Aware Transformer Encoder for Empathetic Dialogue Generation

Harnessing Large Language Models' Empathetic Response Generation Capabilities for Online Mental Health Counselling Support

Enhancing Mental Health Support through Human-AI Collaboration: Toward Secure and Empathetic AI-enabled chatbots

Talk, Listen, Connect: Navigating Empathy in Human-AI Interactions

Facilitating Multi-turn Emotional Support Conversation with Positive Emotion Elicitation: A Reinforcement Learning Approach

EmpCRL: Controllable Empathetic Response Generation via In-Context Commonsense Reasoning and Reinforcement Learning

CheerBots: Chatbots toward Empathy and Emotionusing Reinforcement Learning

Emotion-Aware Response Generation Using Affect-Enriched Embeddings with LLMs

Feel You ’ : Enhancing conversational agents with empathy Name :

Empathy Through Multimodality in Conversational Interfaces

Generative Adversarial Imitation Learning for Empathy-based AI

Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvements

SoulChat: Improving LLMs' Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversations

An Empathetic AI Coach for Self-Attachment Therapy

Generating Empathetic Responses by Looking Ahead the User's Sentiment

Interactive Dialogue Agents via Reinforcement Learning on Hindsight Regenerations

Assessing Empathy in Large Language Models with Real-World Physician-Patient Interactions