Abstract:Virtual counselors powered by large language models (LLMs) aim to create interactive support systems that effectively assist clients struggling with mental health challenges. To replicate counselor-client conversations, researchers have built an online mental health platform that allows professional counselors to provide clients with text-based counseling services for about an hour per session. Notwithstanding its effectiveness, challenges exist as human annotation is time-consuming, cost-intensive, privacy-protected, and not scalable. To address this issue and investigate the applicability of LLMs in psychological counseling conversation simulation, we propose a framework that employs two LLMs via role-playing for simulating counselor-client interactions. Our framework involves two LLMs, one acting as a client equipped with a specific and real-life user profile and the other playing the role of an experienced counselor, generating professional responses using integrative therapy techniques. We implement both the counselor and the client by zero-shot prompting the GPT-4 model. In order to assess the effectiveness of LLMs in simulating counselor-client interactions and understand the disparities between LLM- and human-generated conversations, we evaluate the synthetic data from various perspectives. We begin by assessing the client's performance through automatic evaluations. Next, we analyze and compare the disparities between dialogues generated by the LLM and those generated by professional counselors. Furthermore, we conduct extensive experiments to thoroughly examine the performance of our LLM-based counselor trained with synthetic interactive dialogues by benchmarking against state-of-the-art models for mental health.

LLM-Based Empathetic Response Through Psychologist-Agent Debate

Harnessing Large Language Models' Empathetic Response Generation Capabilities for Online Mental Health Counselling Support

Interactive Agents: Simulating Counselor-Client Psychological Counseling via Role-Playing LLM-to-LLM Interactions

Rational Sensibility: LLM Enhanced Empathetic Response Generation Guided by Self-presentation Theory

Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvements

Enhancing Empathetic Response Generation by Augmenting LLMs with Small-scale Empathetic Models

SoulChat: Improving LLMs' Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversations

PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluation

Emotion-Aware Response Generation Using Affect-Enriched Embeddings with LLMs

EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimization

Are Large Language Models More Empathetic than Humans?

Large Language Models are Capable of Offering Cognitive Reappraisal, if Guided

Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction

Speak From Heart: An Emotion-Guided LLM-Based Multimodal Method for Emotional Dialogue Generation

Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBench

Building Emotional Support Chatbots in the Era of LLMs

Hello Again! LLM-powered Personalized Agent for Long-term Dialogue

Response Generation for Cognitive Behavioral Therapy with Large Language Models: Comparative Study with Socratic Questioning

APTNESS: Incorporating Appraisal Theory and Emotion Support Strategies for Empathetic Response Generation

Multi-dimensional Evaluation of Empathetic Dialog Responses

WundtGPT: Shaping Large Language Models To Be An Empathetic, Proactive Psychologist