CUEMPATHY: A Counseling Speech Dataset for Psychotherapy Research

Dehua Tao,Harold Chui,Sarah Luk,Tan Lee

2024-09-04

Abstract:Psychotherapy or counseling is typically conducted through spoken conversation between a therapist and a client. Analyzing the speech characteristics of psychotherapeutic interactions can help understand the factors associated with effective psychotherapy. This paper introduces CUEMPATHY, a large-scale speech dataset collected from actual counseling sessions. The dataset consists of 156 counseling sessions involving 39 therapist-client dyads. The process of speech data collection, subjective ratings (one observer and two client ratings), and transcription are described. An automatic speech and text processing system is developed to locate the time stamps of speaker turns in each session. Examining the relationships among the three subjective ratings suggests that observer and client ratings have no significant correlation, while the client-rated measures are significantly correlated. The intensity similarity between the therapist and the client, measured by the averaged absolute difference of speaker-turn-level intensities, is associated with the psychotherapy outcomes. Recent studies on the acoustic and linguistic characteristics of the CUEMPATHY are introduced.

Audio and Speech Processing,Sound

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to understand the factors related to effective psychotherapy by analyzing the speech characteristics in the process of psychotherapy or counseling. Specifically, the paper introduces the CUEMPATHY dataset, which is a large - scale voice dataset collected from actual psychological counseling sessions. The main objectives of the research include:

1. **Constructing a large - scale psychological counseling voice dataset**: The CUEMPATHY dataset contains 156 psychological counseling sessions, involving 39 pairs of counselor - client combinations. These data are intended to support the development of voice and language technologies to efficiently analyze psychotherapy interactions and provide data evidence for counselor training.

2. **Subjective evaluation and transcription**: The paper describes the data collection process, subjective evaluation (including observer evaluation and client evaluation), and transcription methods. The research has developed an automatic voice and text processing system to determine the timestamps of speaker transitions in each session.

3. **Exploring the relationships between subjective evaluations**: The research found that there is no significant correlation between observer evaluation and client evaluation, while there are significant correlations among the measures of client evaluation. In addition, the intensity similarity between counselors and clients (measured by the mean absolute difference) is related to the psychotherapy outcome.

4. **Preliminary study of acoustic and language features**: The paper also introduces recent research on acoustic and language features in the CUEMPATHY dataset, which helps predict clinical outcomes and guide counselors on how to speak and express during the counseling process to maximize the treatment effect.

Through these objectives, the paper aims to provide a valuable data resource for psychotherapy research and promote the development of related technologies.