Abstract:Although there is a growing belief that LLMs can be used as therapists, exploring LLMs' capabilities and inefficacy, particularly from the client's perspective, is limited. This work focuses on a client-centered assessment of LLM therapists with the involvement of simulated clients, a standard approach in clinical medical education. However, there are two challenges when applying the approach to assess LLM therapists at scale. Ethically, asking humans to frequently mimic clients and exposing them to potentially harmful LLM outputs can be risky and unsafe. Technically, it can be difficult to consistently compare the performances of different LLM therapists interacting with the same client. To this end, we adopt LLMs to simulate clients and propose ClientCAST, a client-centered approach to assessing LLM therapists by client simulation. Specifically, the simulated client is utilized to interact with LLM therapists and complete questionnaires related to the interaction. Based on the questionnaire results, we assess LLM therapists from three client-centered aspects: session outcome, therapeutic alliance, and self-reported feelings. We conduct experiments to examine the reliability of ClientCAST and use it to evaluate LLMs therapists implemented by Claude-3, GPT-3.5, LLaMA3-70B, and Mixtral 8*7B. Codes are released at <a class="link-external link-https" href="https://github.com/wangjs9/ClientCAST" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

### Problems Addressed by the Paper This paper aims to address the issue of evaluating the capabilities of large language models (LLMs) as psychotherapists, particularly from the client's perspective. Although there is a growing belief that LLMs can be used for psychotherapy, current exploration of LLMs' performance and shortcomings in this field is still very limited. This paper proposes a client-centered evaluation method—ClientCAST (Client-Centered Assessment of LLM Therapists through Simulation)—to reveal the characteristics of LLM therapists. ### Background and Motivation 1. **Inspiration from ELIZA**: Since the discovery that the ELIZA therapy chatbot could provide emotional support, there has been ongoing discussion about whether chatbots can scale up mental health support. 2. **Advances in LLMs**: In recent years, the advanced capabilities of LLMs have further strengthened this argument, with many studies and user feedback indicating the potential of LLMs in psychotherapy. 3. **Potential Risks**: Despite many users finding LLM therapists helpful, there are also potential harms that need to be assessed. ### Research Objectives 1. **Client Perspective Evaluation**: Existing evaluations mainly focus on the therapist's perspective, while this paper aims to evaluate LLM therapists from the client's perspective. 2. **Challenges of Client Simulation**: Traditional client simulation methods use "actors" to simulate clients in clinical medical education, but this approach faces ethical and technical challenges when evaluating LLM therapists. - **Ethical Issues**: Long-term imitation of client symptoms may cause discomfort to individuals and expose them to potentially harmful LLM outputs. - **Technical Issues**: Human behavior varies across different times and interactions, making it difficult to consistently compare the performance of different LLM therapists. ### Methodology 1. **ClientCAST Framework**: - **Client Simulation**: Using LLMs to simulate clients with specific psychological characteristics to interact with LLM therapists. - **Questionnaire Completion**: Simulated clients complete interaction-related questionnaires after the interaction, evaluating three aspects: conversation outcomes, therapeutic alliance, and self-reported feelings. 2. **Experimental Validation**: - **Datasets**: Experiments are conducted using two datasets (High-Low Quality Counseling and AnnoMI). - **LLM Models**: Models such as Claude-3, GPT-3.5, LLaMA3-70B, and Mixtral 8×7B are used for client simulation and evaluation. ### Main Contributions 1. **Proposing ClientCAST**: A new client-centered evaluation method that involves LLM-simulated clients in the evaluation process. 2. **Experimental Results**: Simulated clients generally maintain consistency with their provided psychological characteristics and can effectively distinguish between high-quality and low-quality counseling sessions. 3. **Evaluating Different LLM Therapists**: Using ClientCAST to evaluate the performance of different LLM models as therapists. ### Conclusion By designing and validating ClientCAST, this paper provides a reliable method to evaluate the performance of LLM therapists from the client's perspective. Experimental results show that simulated clients can effectively mimic real client behavior and distinguish between different quality counseling sessions. This provides important references for future research and applications.

Towards a Client-Centered Assessment of LLM Therapists by Client Simulation

Interactive Agents: Simulating Counselor-Client Psychological Counseling via Role-Playing LLM-to-LLM Interactions

A Computational Framework for Behavioral Assessment of LLM Therapists

An LLM-based Simulation Framework for Embodied Conversational Agents in Psychological Counseling

Therapy as an NLP Task: Psychologists' Comparison of LLMs and Human Peers in CBT

Understanding the Therapeutic Relationship between Counselors and Clients in Online Text-based Counseling using LLMs

Who is ChatGPT? Benchmarking LLMs' Psychological Portrayal Using PsychoBench

LLM-based Conversational AI Therapist for Daily Functioning Screening and Psychotherapeutic Intervention via Everyday Smart Devices

Evaluating the Efficacy of Interactive Language Therapy Based on LLM for High-Functioning Autistic Adolescent Psychological Counseling

PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluation

Chatting Up Attachment: Using LLMs to Predict Adult Bonds

PsyDT: Using LLMs to Construct the Digital Twin of Psychological Counselor with Personalized Counseling Style for Psychological Counseling

CBT-Bench: Evaluating Large Language Models on Assisting Cognitive Behavior Therapy

Dr. GPT in Campus Counseling: Understanding Higher Education Students' Opinions on LLM-assisted Mental Health Services

Towards Automatic Evaluation for LLMs' Clinical Capabilities: Metric, Data, and Algorithm

Can AI Relate: Testing Large Language Model Response for Mental Health Support

Language Model Council: Democratically Benchmarking Foundation Models on Highly Subjective Tasks

Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

MEDIC: Towards a Comprehensive Framework for Evaluating LLMs in Clinical Applications

Guidelines For Rigorous Evaluation of Clinical LLMs For Conversational Reasoning