Abstract:Background: In both routine practice contexts and research studies, evidence from standardized self-report symptom measures, administered pre- and post-treatment, is predominantly used to determine whether psychotherapy has been successful. Understanding the nature of unsuccessful psychotherapy requires an ability to evaluate the credibility of outcome data generated by such techniques. An important body of research has identified discrepancies between outcomes assessed through symptom measures and those obtained from other sources. However, not enough is known about the extent to which such paradoxical outcomes exist. Objective: This study analyzes the relationship between outcomes, as assessed by a standardized self-report measure, and as assessed by ratings of young people's descriptions of change at post-counseling interviews. Methods: Participants were 50 young people (13–16 years old) who had taken part in a trial of up to 10 weeks of school-based humanistic counseling. Our primary standardized measure was the Young Person's CORE (YP-CORE). To assess young people's experiences of counseling change, three independent raters scrutinized transcripts of post-counseling interviews, and scored levels of helpfulness on a 1 (Not at all helpful) to 10 (Extremely helpful) scale. Inter-rater reliabilities were 0.94 (Cronbach's Alpha) and 0.96 (McDonald's Omega). Sensitivity analyses were conducted to explore relationships between helpfulness ratings and other outcome measures, i.e., satisfaction with counseling (ESQ) and the Goal-Based-Outcome Tool (GBO), and process measures, i.e., the Working Alliance Inventory (WAI-S) and the Barret Lennard Relationship Inventory (BLRI). Results: Multilevel analysis indicated that helpfulness ratings were not significantly associated with changes in YP-CORE scores. Analyzed categorically, 38% of those showing reliable improvement on the standardized measure were below the median for self-described helpfulness, and 47% of those not showing reliable change were at or above the median for self-described helpfulness. Sensitivity analyses demonstrated closer correlations between helpfulness ratings and other outcome measures (ESQ and GBO), and between helpfulness ratings and process measures (WAI-S and BLRI). Discussion: Our results raise questions about reliance on symptom change outcome measures for defining treatment success and failure, given their disparity with clients' own descriptions of the helpfulness of therapy. Implications for practice and research are discussed.

Self-efficacy, motivation, social support, and alliance as predictors of youth psychotherapy outcomes in usual care

Interpersonal predictors of early therapeutic alliance in a transdiagnostic cognitive-behavioral treatment for adolescents with anxiety and depression.

Are therapist adherence and competence related to clinical outcomes in cognitive-behavioral treatment for youth anxiety?

The alliance–outcome relationship in individual psychotherapy for early psychosis: a secondary analysis of a randomized clinical trial

Youth psychotherapy change trajectories and outcomes in usual care: Community mental health versus managed care settings.

The alliance-outcome relationship in individual psychosocial treatment for schizophrenia and early psychosis: A meta-analysis

Psychotherapy Outcome at Youth Clinics — An Integrative Approach

Therapist verification of patient self-concepts as a responsive precondition for early alliance development and subsequent introject change

Determinants and Outcomes of the Therapeutic Alliance in Treating Justice-Involved Youth: A Systematic Review of Quantitative and Qualitative Research

Cognitive behavioral therapy for youth with social anxiety: Differential short and long-term treatment outcomes

Race/ethnicity and socioeconomic status as predictors of outcome following family therapy in youth at clinical high risk for psychosis

Examining racial and ethnic differences in youth psychotherapy treatment engagement and outcomes.

Moderators of Response to Personalized and Standard Care Cognitive-Behavioral Therapy for Youth with Autism Spectrum Disorder and Comorbid Anxiety

Toward a Level Playing Field: Predictive Factors for the Outcomes of Mental Health Treatment for Adolescents

How do we know whether treatment has failed? Paradoxical outcomes in counseling with young people

Do clinical experience, formal cognitive behavioural therapy training, adherence, and competence predict outcome in cognitive behavioural therapy for anxiety disorders in youth?

A practice‐based study of relational virtues and alliance correspondence in psychodynamic psychotherapy

Cognitive-Behavioral Social Skills Training: Outcome of a Randomized Controlled Trial for Youth at Risk of Psychosis

Comparing Alliance in Two Cognitive-Behavioural Therapies for Adolescents With ADHD Using a Randomized Controlled Trial

Group Psychotherapy or Individual Psychotherapy: Patient Characteristics as Predictive Factors