Abstract:Online peer-to-peer support platforms enable conversations between millions of people who seek and provide mental health support. If successful, web-based mental health conversations could improve access to treatment and reduce the global disease burden. Psychologists have repeatedly demonstrated that empathy, the ability to understand and feel the emotions and experiences of others, is a key component leading to positive outcomes in supportive conversations. However, recent studies have shown that highly empathic conversations are rare in online mental health platforms. In this paper, we work towards improving empathy in online mental health support conversations. We introduce a new task of empathic rewriting which aims to transform low-empathy conversational posts to higher empathy. Learning such transformations is challenging and requires a deep understanding of empathy while maintaining conversation quality through text fluency and specificity to the conversational context. Here we propose PARTNER, a deep reinforcement learning agent that learns to make sentence-level edits to posts in order to increase the expressed level of empathy while maintaining conversation quality. Our RL agent leverages a policy network, based on a transformer language model adapted from GPT-2, which performs the dual task of generating candidate empathic sentences and adding those sentences at appropriate positions. During training, we reward transformations that increase empathy in posts while maintaining text fluency, context specificity and diversity. Through a combination of automatic and human evaluation, we demonstrate that PARTNER successfully generates more empathic, specific, and diverse responses and outperforms NLP methods from related tasks like style transfer and empathic dialogue generation. Our work has direct implications for facilitating empathic conversations on web-based platforms.

Promoting Constructive Interaction And Moral Behaviors Using Adaptive Empathetic Learning

Reaching Cooperation Using Emerging Empathy and Counter-empathy.

Artificial Empathy: A New Perspective for Analyzing and Designing Multi-Agent Systems

Building Altruistic and Moral AI Agent with Brain-inspired Affective Empathy Mechanisms

Modeling adaptive empathy based on neutral assessment: a way to enhance the prosocial behaviors of socialized agents under the premise of self-security

Learning to Balance Altruism and Self-interest Based on Empathy in Mixed-Motive Games

Preferential Learning and Memory Resolve Social Dilemma

Brain-Inspired Affective Empathy Computational Model and Its Application on Altruistic Rescue Task

Engineering Optimal Cooperation Levels with Prosocial Autonomous Agents in Hybrid Human-Agent Populations: An Agent-Based Modeling Approach

Human-Robot Emotional Interaction Model Based on Reinforcement Learning

Improving moral reasoning among college students: a game-based learning approach

Adaptive Empathy: Empathic Response Selection as a Dynamic, Feedback-Based Learning Process

Social decision-making in a large-scale MultiAgent system considering the influence of empathy

EMOTE: An Explainable architecture for Modelling the Other Through Empathy

Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approach

Synergistic effects of adaptive reward and reinforcement learning rules on cooperation

Dynamics of Moral Behavior in Heterogeneous Populations of Learning Agents

Empathic Coupling of Homeostatic States for Intrinsic Prosociality

Enhancing Cooperation through Selective Interaction and Long-term Experiences in Multi-Agent Reinforcement Learning

EmpCRL: Controllable Empathetic Response Generation via In-Context Commonsense Reasoning and Reinforcement Learning

Learning enables adaptation in cooperation for multi-player stochastic games