Do Therapists Know When Their Clients Deteriorate? An Investigation of Therapists' Ability to Estimate and Predict Client Change During and After Psychotherapy

Ole Karkov Østergård,Lasse Grønnebæk,Kristine Kahr Nilsson

DOI: https://doi.org/10.1002/cpp.70015

2024-11-27

Clinical Psychology & Psychotherapy

Abstract:Clinical Psychology &Psychotherapy, Volume 31, Issue 6, November/December 2024.

psychology, clinical

What problem does this paper attempt to address?

How do we know whether treatment has failed? Paradoxical outcomes in counseling with young people

John McLeod,Erik Stänicke,Hanne Weie Oddli,Stephanie Smith,Peter Pearce,Mick Cooper

DOI: https://doi.org/10.3389/fpsyg.2024.1390579

IF: 3.8

2024-06-04

Frontiers in Psychology

Abstract:Background: In both routine practice contexts and research studies, evidence from standardized self-report symptom measures, administered pre- and post-treatment, is predominantly used to determine whether psychotherapy has been successful. Understanding the nature of unsuccessful psychotherapy requires an ability to evaluate the credibility of outcome data generated by such techniques. An important body of research has identified discrepancies between outcomes assessed through symptom measures and those obtained from other sources. However, not enough is known about the extent to which such paradoxical outcomes exist. Objective: This study analyzes the relationship between outcomes, as assessed by a standardized self-report measure, and as assessed by ratings of young people's descriptions of change at post-counseling interviews. Methods: Participants were 50 young people (13–16 years old) who had taken part in a trial of up to 10 weeks of school-based humanistic counseling. Our primary standardized measure was the Young Person's CORE (YP-CORE). To assess young people's experiences of counseling change, three independent raters scrutinized transcripts of post-counseling interviews, and scored levels of helpfulness on a 1 (Not at all helpful) to 10 (Extremely helpful) scale. Inter-rater reliabilities were 0.94 (Cronbach's Alpha) and 0.96 (McDonald's Omega). Sensitivity analyses were conducted to explore relationships between helpfulness ratings and other outcome measures, i.e., satisfaction with counseling (ESQ) and the Goal-Based-Outcome Tool (GBO), and process measures, i.e., the Working Alliance Inventory (WAI-S) and the Barret Lennard Relationship Inventory (BLRI). Results: Multilevel analysis indicated that helpfulness ratings were not significantly associated with changes in YP-CORE scores. Analyzed categorically, 38% of those showing reliable improvement on the standardized measure were below the median for self-described helpfulness, and 47% of those not showing reliable change were at or above the median for self-described helpfulness. Sensitivity analyses demonstrated closer correlations between helpfulness ratings and other outcome measures (ESQ and GBO), and between helpfulness ratings and process measures (WAI-S and BLRI). Discussion: Our results raise questions about reliance on symptom change outcome measures for defining treatment success and failure, given their disparity with clients' own descriptions of the helpfulness of therapy. Implications for practice and research are discussed.

psychology, multidisciplinary
"It takes time to see the whole picture": patients' views on improvement in cognitive behavioral therapy and psychodynamic therapy after three years

Anders Malkomsen,Jan Ivar Røssberg,Toril Dammen,Theresa Wilberg,André Løvgren,Randi Ulberg,Julie Evensen

DOI: https://doi.org/10.3389/fpsyt.2024.1342950

IF: 4.7

2024-03-15

Frontiers in Psychiatry

Abstract:Introduction: There is a lack of qualitative research that retrospectively explores how patients with major depressive disorder view their improvement in psychotherapy. Methods: Fifteen patients who received short-term cognitive behavioral therapy and psychodynamic therapy were individually interviewed approximately three years after completing therapy. Results: Some patients had altered their views on therapy, especially those who initially were uncertain of how helpful therapy had been. They said they did not realize the extent and importance of their improvement in therapy before some time had passed, which can be explained by the surprising cumulative effects of seemingly small changes. Discussion: This should make retrospective qualitative research an important part of future psychotherapy research.

psychiatry
Changes in therapists' client dropout rates over time: Findings from a practice‐research group

Matteo Bugatti,Jesse Owen,Zachary Richardson,Wendy Rasmussen,Douglas A. Newton

DOI: https://doi.org/10.1002/jcad.12521

2024-05-02

Journal of Counseling & Development

Abstract:Research has failed to consistently show that therapists facilitate better client outcomes as they gain more experience. The present study was designed to examine changes in early client retention over the course of extended periods of time among 2591 therapists in private practice. Naturalistic data collected between 2018 and 2022 was extracted from a technology‐enabled practice‐research group (PRG). Therapists displayed an increase in client dropout rates as they gained more experience on the PRG. Additionally, larger caseloads on the PRG were associated with lower increases in client dropout over time. Finally, therapists working with clients paying higher out‐of‐pocket fees (e.g., co‐pays) had higher increases in client dropout over time. These findings provide additional evidence supporting the distinction between clinical experience and expertise.

psychology, applied
Understanding "patient deterioration" in psychotherapy from depressed patients' perspectives: A mixed methods multiple case study

Melissa Miléna De Smet,Emma Acke,Shana Cornelis,Femke Truijens,Liza Notaerts,Reitske Meganck,Mattias Desmet

DOI: https://doi.org/10.1080/10503307.2024.2309286

2024-02-08

Psychotherapy Research

Abstract:Objective: This study scrutinizes the meaning of deterioration in psychotherapy beyond the widely used statistical definition of reliable symptom increase pre-to-post treatment.

psychology, clinical
Does a therapist's reflective ability predict the accuracy of their self-evaluation of competence in cognitive behavioural therapy?

Maria E. Loades,Pamela J. Myles

DOI: https://doi.org/10.1017/s1754470x16000027

2016-01-01

The Cognitive Behaviour Therapist

Abstract:Abstract Accurately evaluating how competently one is performing can be a precursor to seeking training and supervision, therefore contributing to safe, effective practice. Little is known about what predicts accurate self-evaluation. Prior research findings are inconsistent, with overestimation of self-rated competence in some studies and underestimation in others. We aimed t o explore the relationship between therapists' reflective ability and the level of agreement between self-rated competence and competence rated by an experienced CBT assessor. Thirteen trainees undertaking a postgraduate CBT diploma submitted a series of recordings accompanied by self-ratings using the Cognitive Therapy Scale – Revised (CTS-R) and related written reflective analyses. Independent assessors marked the written analyses using a standardized marking scheme and rated the therapy sessions using the CTS-R. Trainees tended to overestimate or underestimate their competence in comparison to the independent assessors. The level of agreement between the assessors' ratings and self-evaluation of competence tended to improve during training, while reflective ability did not. Reflective ability was significantly related to level of agreement between self-rated and assessor-rated competence. Trainees do not consistently demonstrate the bias for overestimating their competence previously found in qualified therapists. During training, the tendency of an individual to over- or underestimate their competence may not remain stable, but tends to become more consistent with ratings undertaken by an experienced CBT assessor. Trainees who were rated as more reflective, tended to agree more closely with independent assessors on evaluation of competence. Therefore, enhancing reflective ability may help therapists to more accurately self-evaluate their competence.

English Else
Do Patient's Interpersonal Problems Improve Following Metacognitive Therapy? A Systematic Review and Meta‐Analysis

Eivind R. Strand,Henrik Nordahl

DOI: https://doi.org/10.1002/cpp.2973

2024-04-06

Clinical Psychology & Psychotherapy

Abstract:Clinical Psychology &Psychotherapy, Volume 31, Issue 2, March/April 2024.

psychology, clinical
Is training effective? A study of counseling psychology doctoral trainees in a psychodynamic/interpersonal training clinic.

Clara E. Hill,Ellen Baumann,Naama Shafran,Shudarshana Gupta,Ashley Morrison,Andrés E. Pérez Rojas,Patricia T. Spangler,Shauna Griffin,Laura Pappa,Charles J. Gelso

DOI: https://doi.org/10.1037/cou0000053

IF: 5.088

2015-01-01

Journal of Counseling Psychology

Abstract:We investigated changes over 12 to 42 months in 23 predoctoral trainees during their externship training in a psychodynamic/interpersonal psychotherapy clinic. Over time, trainees increased in client-rated working alliance and real relationship, therapist-rated working alliance, client-rated interpersonal functioning, ability to use helping skills (e.g., challenges, immediacy), higher-order functioning (e.g., conceptualization ability, countertransference management), feelings about themselves as therapists (e.g., more authentic, more self-aware), and understanding about being a therapist (e.g., theoretical orientation, curiosity about client dynamics). In contrast, trainees did not change in engaging clients (return after intake or for at least 8 sessions), judge-rated psychodynamic techniques in third and ninth sessions across clients (although trainees used more cognitive-behavioral techniques over time in third but not ninth sessions), or changes in client-rated symptomatology. Trainees primarily attributed changes to graduate training, individual and group supervision, research participation, and working with clients. Implications for training and research are discussed.

psychology, educational, applied
Correction to Goldberg et al. (2016).

DOI: https://doi.org/10.1037/cou0000666

IF: 5.088

2023-07-19

Journal of Counseling Psychology

Abstract:Reports an error in "Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting" by Simon B. Goldberg, Tony Rousmaniere, Scott D. Miller, Jason Whipple, Stevan Lars Nielsen, William T. Hoyt and Bruce E. Wampold ( Journal of Counseling Psychology , 2016[Jan], Vol 63[1], 1-11). The article (https://doi.org/10.1037/cou0000131), had an error in the Method section in the Early termination section under the Variables heading. The coding was reversed in the sentence "Patients received a code of 0 (early termination) or 1 (nonearly termination) on this dichotomous variable" and should have read "Patients received a code of 1 (early termination) or 0 (nonearly termination) on this dichotomous variable." The online version of this article has been corrected. (The following abstract of the original article appeared in record 2015-58774-001.) Objective: Psychotherapy researchers have long questioned whether increased therapist experience is linked to improved outcomes. Despite numerous cross-sectional studies examining this question, no large-scale longitudinal study has assessed within-therapist changes in outcomes over time. Method: The present study examined changes in psychotherapists' outcomes over time using a large, longitudinal, naturalistic psychotherapy data set. The sample included 6,591 patients seen in individual psychotherapy by 170 therapists who had on average 4.73 years of data in the data set (range = 0.44 to 17.93 years). Patient-level outcomes were examined using the Outcome Questionnaire-45 and a standardized metric of change (prepost d). Two-level multilevel models (patients nested within therapist) were used to examine the relationship between therapist experience and patient prepost d and early termination. Experience was examined both as chronological time and cumulative patients seen. Results: Therapists achieved outcomes comparable with benchmarks from clinical trials. However, a very small but statistically significant change in outcome was detected indicating that on the whole, therapists' patient prepost d tended to diminish as experience (time or cases) increases. This small reduction remained when controlling for several patient-level, caseload-level, and therapist-level characteristics, as well as when excluding several types of outliers. Further, therapists were shown to vary significantly across time, with some therapists showing improvement despite the overall tendency for outcomes to decline. In contrast, therapists showed lower rates of early termination as experience increased. Conclusions: Implications of these findings for the development of expertise in psychotherapy are explored. (PsycInfo Database Record (c) 2023 APA, all rights reserved)

psychology, educational, applied
Therapist effects on early change in psychotherapy in a naturalistic setting

David M. Erekson,Rachelle Clayson,So Yeon Park,Shannon Tass

DOI: https://doi.org/10.1080/10503307.2018.1556824

2018-12-14

Psychotherapy Research

Abstract:Objective: Client trajectories of change in psychotherapy differ. Early change is a trajectory that has been shown to be associated with better outcomes over time. Little is known about the mechanisms of this type of change, however. The current study examined the therapist effect in early change, and explored differences between therapists in the likelihood that early change would occur and how early in a course of therapy the change would occur.Methods: Using 20 years of archival data from a university counseling center, we identified 16,825 clients who had been seen by 273 therapists. We examined therapist differences using chi-square analyses, multilevel logistic regression, and survival analyses.Results: We found significant variance between therapists in both their likelihood to predict early change, and how early that change was predicted to occur. Therapist effects, however, accounted for a small portion of the overall variance; despite this small effect, differences between the best performing therapists and the worst performing therapists were substantial.Conclusions: Therapists were differentially effective in helping clients achieve early change. Future research examining mechanisms associated with these effects will be important in informing psychotherapy process and therapist training.

psychology, clinical
Rethinking treatment failures. Research on a group of Italian psychotherapists

Osmano Oasi,Francesca De Salve,Chiara Rossi,Simone Maggio,Ilaria Casabona,Sara Molgora

DOI: https://doi.org/10.3389/fpsyg.2024.1403736

2024-08-05

Abstract:Introduction: Psychotherapeutic failures involve situational, relational, and personal factors. Dropout refers to a patient's unilateral termination of treatment without the therapist's knowledge or approval. Premature termination occurs when therapy is discontinued before achieving a sufficient reduction in initial problems. Objective: This study explores the role of therapist's emotional response (countertransference), gender, psychotherapeutic orientation, and patient diagnosis in the context of psychotherapeutic failures. Method: A mixed-method approach was used. Fifty-nine Italian psychotherapists, practicing mostly privately with at least 5 years of experience, were recruited through Italian professional internet websites. The Therapist Response Questionnaire and the Impasse Interview were administered to each psychotherapist. Each therapist was asked to reflect on their last dropout patient. Quantitative (MANOVA) and qualitative analyses (textual content analysis) were conducted with SPSS and T-LAB, respectively. Results: The quantitative analyses revealed that the most frequent countertransference response was Helpless/Inadequate, with female therapists experiencing this more frequently than male therapists. The qualitative analyses identified two main factors explaining most of the variance in countertransference responses: Parental/Protective versus Hostile/Angry, and Positive/Satisfying versus Helpless/Inadequate, with Helpless/Inadequate central. Additionally, the qualitative analysis of treatment interruption methods revealed two factors explaining over 50% of the variance. Lack of communication was linked to negative themes, while mediated and direct communication were associated with positive terms. Direct communication was characterized as useful, while mediated communication was linked to dropout and attachment figures. Conclusion: Under pressure, psychotherapists' anxiety levels increase, often managed ambivalently or avoidantly. These results suggest that awareness of psychotherapist emotional responses is important to limit psychotherapeutic failures. These findings offer valuable insights for clinical practice.
Klinische Urteilsbildung und Beziehungskompetenz in der Psychotherapie älterer PatientInnen

Meinolf Peters,Tobias Becker,Karin Jeschke

DOI: https://doi.org/10.1055/a-2250-5405

2024-03-31

PPmP - Psychotherapie · Psychosomatik · Medizinische Psychologie

Abstract:Die in der Vergangenheit negative Einstellung von PsychotherapeutInnen zur Behandlung älterer PatientInnen hat sich in der jüngeren Vergangenheit abgeschwächt. Dennoch bleibt die Frage, wie Therapeuten ältere im Vergleich zu jüngeren Patientinnen wahrnehmen, zu welchen klinischen Urteilen sie gelangen und wie sie die Beziehung zu diesen wahrnehmen. In der vorliegenden Untersuchung, die im Rahmen der ÄPP-Studie (Ältere PatientInnen in der Psychotherapie) durchgeführt wurde, sollten TherapeutInnen einen selbst gewählten jüngeren ( 65) im Hinblick auf verschiedene Variablen beurteilen. Es standen 527 vollständig ausgefüllt Fragebögen zur Verfügung. Mit Hilfe zweifaktorieller Varianzanalysen konnte u. a. gezeigt werden, dass jüngere TherapeutInnen (im Vergleich zu ihren älteren Kollegen) ältere PatientInnen negativer bewerten in Bezug auf die Eignung für Psychotherapie, die Fähigkeit der PatientInnen zum Aufbau einer therapeutischen Arbeitsbeziehung sowie weiteren Parametern. Jüngere TherapeutInnen erleben sich im Vergleich mit ihren älteren KollegInnen gegenüber älteren Patienten als weniger beziehungskompetent. Bei jüngeren PatientInnen gibt es nur geringe Unterschiede. The negative attitude of psychotherapists towards the treatment of older patients in the past has weakened in the recent past. Nevertheless, the question remains as to how therapists perceive older patients in comparison to younger patients, what clinical judgements they arrive at and how they perceive the relationship with them. In the present study, which was conducted as part of the ÄPP study (Older Patients in Psychotherapy), therapists were asked to assess a self-selected younger ( 65) with regard to various variables. A total of 527 completed questionnaires were available. Two-factor analyses of variance were used to show, among other things, that younger therapists (compared to their older colleagues) rate older patients more negatively in terms of suitability for psychotherapy, the patient's ability to establish a therapeutic working relationship and other parameters. In comparison with their older colleagues, younger therapists perceive themselves as less competent in their relationships with older patients. There are only slight differences with younger patients. Received: 14 August 2023 Accepted: 04 January 2024 Article published online: 29 March 2024 © 2024. Thieme. All rights reserved. Georg Thieme Verlag KG Rüdigerstraße 14, 70469 Stuttgart, Germany

psychology, clinical
Retraction of Keum et al. (2021).

DOI: https://doi.org/10.1037/cou0000678

IF: 5.088

2023-07-19

Journal of Counseling Psychology

Abstract:Reports the retraction of "Do therapists improve in their ability to assess clients' satisfaction? A truth and bias model" by Brian TaeHyuk Keum, Katherine Morales Dixon, Dennis M. Kivlighan Jr., Clara E. Hill and Charles J. Gelso ( Journal of Counseling Psychology , 2021[Oct], Vol 68[5], 608-620). The following article (https://doi.org/10.1037/cou0000525) is being retracted. This retraction is at the request of coauthors Kivlighan, Hill, and Gelso after the results of an investigation by the University of Maryland Institutional Review Board (IRB). The IRB found that the study included data from between one and four therapy clients of the Maryland Psychotherapy Clinic and Research Laboratory (MPCRL) who either had not been asked to provide consent or had withdrawn consent for their data to be included in the research. Keum and Dixon were not responsible for obtaining and verifying participant consent but agreed to the retraction of this article. (The following abstract of the original article appeared in record 2020-51285-001.) We used the truth and bias model to examine changes in tracking accuracy and under/overestimation (directional bias) on therapists' judgments about clients' satisfaction. We examined 3 factors of clinical experience that could moderate accuracy: (a) overall level of acquaintanceship with a client, operationalized as treatment length (i.e., less or more time seeing a client), (b) time point in therapy with a specific client, operationalized as session number (i.e., earlier or later in treatment with a client), and (c) order (1st client seen, 2nd client seen . . . last client seen across two years of training in a psychology clinic) in which clients were seen. We conducted a three-level hierarchical linear modeling using data on 6054 sessions, nested in 284 adult clients, nested in 41 doctoral student therapists providing open-ended psychodynamic individual psychotherapy. We found that therapists were able to accurately track client-rated session evaluations with less underestimation (i.e., lower tendency to estimate that clients were less satisfied than they actually were) as they gained experience (both treatment length and client order). Furthermore, therapists exhibited greater tracking accuracy gains over the span of shorter treatments and when working with clients earlier in their clinical training. In longer treatments and with clients seen later in training, tracking accuracy was stable and consistent. Implications for research and practice are discussed. (PsycInfo Database Record (c) 2023 APA, all rights reserved)

psychology, educational, applied
Good-enough Care? How Patients' Perceptions of Counselors' Professional Skills Relate to Everyday Life in Forensic Long-stay Units

Steven Degrauwe,Kim Dierckx,Vicky Van Bulck,Marie-Céline Gouwy,Lize Verbeke,Jasmine Vergauwe,Barbara De Clercq

DOI: https://doi.org/10.1097/PRA.0000000000000799

2024-07-01

Abstract:The overall goal of long-term forensic care is to strive toward acceptable levels of adaptation and quality of life (QoL) of the forensic patient in the institutional context. While the bulk of the literature has focused on the deleterious consequences of personality pathology in this regard, research investigating the contribution of the quality of the therapeutic relationship has remained rather scant. Assuming that the perceived competence of the direct counselor, as perceived by patients, forms an important aspect in this regard, the central aim of this study was to investigate the relationship between patients' perceptions of their therapist's professional skills, their self-reported maladaptive behavior on the ward, and their experienced QoL. To this end, we recruited patients (N = 60) in long-stay forensic units and investigated their perceptions of 10 specific skills displayed by their therapist, along a "too little-too much" rating scale. The results revealed that patients who had the overall impression that their counselor was equipped with an adequate set of professional skills showed less maladaptive behavior and perceived a higher QoL on the ward. Conversely, at a more specific competence level, only a positive relationship between a counselor's predictability and self-reported QoL was found. Taken together, these results highlight that an overall professional skill evaluation matters in the context of forensic patients' adaptation and QoL in their long-stay units, with the counselor's predictability serving as a crucial aspect in obtaining the most favorable outcomes.
Investigating the dose–response effect in open-ended psychotherapy

Magnus Nordmo,Jon T. Monsen,Per Andreas Høglend,Ole Andre Solbakken

DOI: https://doi.org/10.1080/10503307.2020.1861359

2020-12-17

Psychotherapy Research

Abstract:Findings from previous psychotherapy research suggest that the majority of improvement takes place in the initial phase of treatment with the relative effectiveness dropping at a negatively accelerating rate. However, the evidence for this pattern of change comes from investigations of short-term treatments and it is unclear whether this also holds for more flexible and long-term psychotherapy. We provided open-ended treatments under routine-care conditions for a representative sample of 362 patients, including a large proportion characterized by severe psychopathology. Patients attended 52 sessions on average (SD = 59, range = 1-364, Mdn = 36). Our results indicated that the degree of improvement was linearly associated with time spent in psychotherapy and contingent upon the severity of psychological problems at intake. The least severely afflicted received the shortest treatments, experienced the most rapid change but demonstrated smaller overall magnitudes of improvement. More severely suffering patients received longer treatments, had slower rates of change but in general received greater overall benefits. We argue that previous suggestions of psychotherapy dosage have been less appropriate for patients suffering from moderate to severe psychopathology.

psychology, clinical
First impressions count: Therapists' impression on patients' motivation and helping alliance predicts psychotherapy dropout

Kristin Jankowsky,Johannes Zimmermann,Ulrich Jaeger,Robert Mestel,Ulrich Schroeders

DOI: https://doi.org/10.1080/10503307.2024.2411985

2024-10-11

Psychotherapy Research

Abstract:Objective With meta-analytically estimated rates of about 25%, dropout in psychotherapies is a major concern for individuals, clinicians, and the healthcare system at large. To be able to counteract dropout in psychotherapy, accurate insights about its predictors are needed.

psychology, clinical
Disentangling the Therapist Effect: Clustering Therapists by Using Different Treatment Outcomes

Pauline Janse,Naline Geurtzen,Agathe Scappini,Giel Hutschemaekers

DOI: https://doi.org/10.1007/s10488-024-01365-3

2024-03-22

Administration and Policy in Mental Health and Mental Health Services Research

Abstract:Previous studies have shown that therapists' performance varies, known as therapist effects, and have indicated that therapists who excel in one treatment outcome may not necessarily be effective in other outcomes. This observational naturalistic study aimed to enhance our understanding of therapist effects and the assessment of therapists' performance in different areas. The study included 68 therapists and 5,582 clients from a large mental health facility. Information about their learning activities was available for a subsample of 49 therapists. Separate multilevel analyses were conducted for treatment outcomes, including case mix-corrected OQ-45 change scores, dropout rates, referrals to other facilities, treatment duration, and client satisfaction ratings. A hierarchical cluster analysis was performed to identify groups of therapists based on their performance across various treatment outcomes. Additionally, differences in therapist characteristics among the clusters identified were examined. Therapist effects varied across different outcomes, ranging from small (2.6% for OQ-45 change) to moderate (6.5% for number of sessions). The cluster analysis revealed four distinct clusters of therapists with specific profiles. They had performance differences in certain areas but not in others. This exploratory study supports the notion that therapists exhibit diverse profiles regarding treatment outcomes. These findings are significant for future investigations of therapist effects that aim to identify the characteristics of effective therapists and in the context of personalizing treatment for clients.

public, environmental & occupational health,health policy & services
Client resources and the prediction of therapeutic change using an interview: An exploratory study

Carina Magalhães,João Tiago Oliveira,Andreia Milhazes,Pablo Fernández-Navarro,Rui Braga,Patrícia Pinheiro,Robert A. Neimeyer,Miguel M. Gonçalves

DOI: https://doi.org/10.1080/10503307.2024.2394191

2024-08-31

Psychotherapy Research

Abstract:Objectives Although psychotherapy research suggests that clients' resources are related to positive outcomes, there is a lack of clinical tools available to consider their integration into psychotherapy. In this exploratory research, we studied the feasibility of a semi-structured interview to identify resources reported by clients at the onset of therapy and the relationship between resources and therapy outcomes.

psychology, clinical
A Scale for Measuring Positive and Negative Experiences of Psychotherapy (PNEP): First Psychometric Findings of a New Instrument for Monitoring Clients' Experiences

Brechje Dandachi‐FitzGerald,Sanne T. L. Houben,Nick J. Broers,Harald Merckelbach

DOI: https://doi.org/10.1002/cpp.3014

2024-06-06

Clinical Psychology & Psychotherapy

Abstract:Background Clients' adverse experiences during psychotherapy are rarely monitored in clinical practice or research trials. One obstacle here is the lack of a measure to gauge both positive and negative experiences during psychotherapy. We developed and evaluated a new instrument for measuring such experiences. Method The Positive and Negative Experiences of Psychotherapy (PNEP) questionnaire was developed based on pilot data, a literature review, and two existing scales for measuring primarily adverse experiences during psychotherapy. Mental healthcare clients (N = 200) anonymously completed and evaluated the PNEP. Subsequently, a sample of professionals (N = 34) who underwent psychotherapy in the context of their training filled in the PNEP twice, with a 2‐week interval in between. Results The positive and negative experiences subscales of the PNEP were found to possess excellent internal consistencies (αs ≥ 0.90). The PNEP test–retest reliability was 0.93 for the positive experiences subscale and 0.78 for the negative experiences subscale. For the positive subscale, four factors were extracted: symptom reduction and positive well‐being, high quality of therapy and therapeutic relation, personal growth and acceptance and interpersonal functioning. For the negative subscale, exploratory factor analysis suggested a three‐factor solution: escalation of symptoms and emotional distress, low quality of therapy and therapeutic relation and (self‐)stigmatization and dependency. Participants related a median of 13 positive and six negative therapy experiences to their most recent treatment. The most frequently endorsed negative experiences were having more negative thoughts and memories, feeling emotionally overwhelmed and an increase in stress due to the therapy. A minority of participants (10.5%) reported no negative treatment experiences. Conclusions In the field of psychotherapy, the evaluation of risks and benefits is crucial for assessing safety and effectiveness. The PNEP could be a promising instrument for achieving this objective, although further research is needed to replicate and expand upon the current findings.

psychology, clinical
When meta-analysis misleads: A critical case study of a meta-analysis of client feedback.

Barry L. Duncan,Jacqueline A. Sparks

DOI: https://doi.org/10.1037/ser0000398

2020-11-01

Psychological Services

Abstract:Consumers of psychotherapy outcome literature consider meta-analysis the gold standard for assessing the efficacy of interventions across disparate studies. Many assume that findings are valid, especially when published in journals with research credentials. Uncritical acceptance, however, can result in real-world consequences, including whether interventions attain evidence-based status or become marginalized or are considered for implementation in public service arenas. This article examines one meta-analysis, "The Effect of Using the Partners for Change Outcome Management System as Feedback Tool in Psychotherapy—A Systematic Review and Meta-Analysis" (Østergård, Randa, & Hougaard, 2018). The findings are at odds with both the empirical record of routine outcome management as well as professional taskforce recommendations and thus provide an ideal exemplar of the risks of uncritically accepting the conclusions of a meta-analysis. Using guidelines from the Cochrane Handbook for Systematic Reviews of Interventions (Higgins & Green, 2011) and a qualitative case study methodology, this article examines Østergård et al.'s (2018) study selection, quality of evidence, and appropriateness of interpretation, emphasizing the link between flawed method and the ultimate validity of its conclusions. The method illustrated in this case study can be used to assess the legitimacy of meta-analytic findings to inform practice, funding, and policy decisions as well as how rhetoric minimizes flaws and bolsters believability. Our analysis revealed that half of the selected studies of the meta-analysis contained significant limitations, including inadequate dose of treatment and/or adherence problems, thereby calling into question its conclusions. (PsycInfo Database Record (c) 2020 APA, all rights reserved)

psychology, clinical
Growth in challenging situations: A qualitative investigation of therapists' experience of delivering emotion-focused therapy

Jan Reidar Stiegler,Elisabeth Schanche,Yngvild Sørebø Danielsen,Aslak Hjeltnes

DOI: https://doi.org/10.1080/10503307.2024.2432680

2024-12-04

Psychotherapy Research

Abstract:Objective: Psychotherapy does not work equally well for all clients. For research to support clinicians in helping more clients, we need to better understand the process of when therapy become particularly challenging. In this study, we investigated challenging change processes from the therapists' perspective when applying Emotion-Focused Therapy (EFT). Method: We interviewed 14 therapists trained in EFT about their experiences of difficulties with applying EFT to clients with varying severity of mental health difficulties. Interviews were analyzed using reflexive thematic analysis. Results: Five themes were constructed. Three describing what EFT therapist find challenging; (1) Challenges in the therapeutic relationship, (2) When feelings are too big, too small or difficult to experience, (3) Matching EFT with the client's challenges, and two describing therapist responses to the challenges: (4) Do I know EFT, and what would I have needed to know more? (5) What do I do when it becomes difficult? A total of 20 subthemes were identified. Conclusion: Reported experiences of applying EFT to a diverse population suggests a need for either model refinement or strengthening of the dissemination process to better enable EFT-therapists to help clients with more severe mental health difficulties.

psychology, clinical

Do Therapists Know When Their Clients Deteriorate? An Investigation of Therapists' Ability to Estimate and Predict Client Change During and After Psychotherapy

How do we know whether treatment has failed? Paradoxical outcomes in counseling with young people

"It takes time to see the whole picture": patients' views on improvement in cognitive behavioral therapy and psychodynamic therapy after three years

Changes in therapists' client dropout rates over time: Findings from a practice‐research group

Understanding "patient deterioration" in psychotherapy from depressed patients' perspectives: A mixed methods multiple case study

Does a therapist's reflective ability predict the accuracy of their self-evaluation of competence in cognitive behavioural therapy?

Do Patient's Interpersonal Problems Improve Following Metacognitive Therapy? A Systematic Review and Meta‐Analysis

Is training effective? A study of counseling psychology doctoral trainees in a psychodynamic/interpersonal training clinic.

Correction to Goldberg et al. (2016).

Therapist effects on early change in psychotherapy in a naturalistic setting

Rethinking treatment failures. Research on a group of Italian psychotherapists

Klinische Urteilsbildung und Beziehungskompetenz in der Psychotherapie älterer PatientInnen

Retraction of Keum et al. (2021).

Good-enough Care? How Patients' Perceptions of Counselors' Professional Skills Relate to Everyday Life in Forensic Long-stay Units

Investigating the dose–response effect in open-ended psychotherapy

First impressions count: Therapists' impression on patients' motivation and helping alliance predicts psychotherapy dropout

Disentangling the Therapist Effect: Clustering Therapists by Using Different Treatment Outcomes

Client resources and the prediction of therapeutic change using an interview: An exploratory study

A Scale for Measuring Positive and Negative Experiences of Psychotherapy (PNEP): First Psychometric Findings of a New Instrument for Monitoring Clients' Experiences

When meta-analysis misleads: A critical case study of a meta-analysis of client feedback.

Growth in challenging situations: A qualitative investigation of therapists' experience of delivering emotion-focused therapy