Abstract:Background: Achieving high quality outcomes in a community context requires the strategic coordination of many activities in a service system, involving families, clinicians, supervisors, and administrators. In modern implementation trials, the therapy itself is guided by a treatment manual; however, structured supports for other parts of the service system may remain less well-articulated (e.g., supervision, administrative policies for planning and review, information/feedback flow, resource availability). This implementation trial investigated how a psychosocial intervention performed when those non-therapy supports were not structured by a research team, but were instead provided as part of a scalable industrial implementation, testing whether outcomes achieved would meet benchmarks from published research trials. Method: In this single-arm observational benchmarking study, a total of 59 community clinicians were trained in the Modular Approach to Therapy for Children (MATCH) treatment program. These clinicians delivered MATCH treatment to 166 youth ages 6 to 17 naturally presenting for psychotherapy services. Clinicians received substantially fewer supports from the treatment developers or research team than in the original MATCH trials and instead relied on explicit process management tools to facilitate implementation. Prior RCTs of MATCH were used to benchmark the results of the current initiative. Client improvement was assessed using the Top Problems Assessment and Brief Problem Monitor. Results: Analysis of client symptom change indicated that youth experienced improvement equal to or better than the experimental condition in published research trials. Similarly, caregiver-reported outcomes were generally comparable to those in published trials. Conclusions: Although results must be interpreted cautiously, they support the feasibility of using process management tools to facilitate the successful implementation of MATCH outside the context of a formal research or funded implementation trial. Further, these results illustrate the value of benchmarking as a method to evaluation industrial implementation efforts.Plain Language Summary: Randomized effectiveness trials are inclusive of clinicians and cases that are routinely encountered in community-based settings, while continuing to rely on the research team for both clinical and administrative guidance. As a result, the field still struggles to understand what might be needed to support sustainable implementation and how interventions will perform when brought to scale in community settings without those clinical trial supports. Alternative approaches are needed to delineate and provide the clinical and operational support needed for implementation and to efficiently evaluate how evidence-based treatments perform. Benchmarking findings in the community against findings of more rigorous clinical trials is one such approach. This paper offers two main contributions to the literature. First, it provides an example of how benchmarking is used to evaluate how the Modular Approach to Therapy for Children (MATCH) treatment program performed outside the context of a research trial. Second, this study demonstrates that MATCH produced comparable symptom improvements to those seen in the original research trials and describes the implementation strategies associated with this success. In particular, although clinicians in this study had less rigorous expert clinical supervision as compared with the original trials, clinicians were provided with process management tools to support implementation. This study highlights the importance of evaluating the performance of intervention programs when brought to scale in community-based settings. This study also provides support for the use of process management tools to assist providers in effective implementation.

Benchmarking Treatment Adherence and Therapist Competence in Individual Cognitive-Behavioral Treatment for Youth Anxiety Disorders

Are therapist adherence and competence related to clinical outcomes in cognitive-behavioral treatment for youth anxiety?

Does the Delivery of CBT for Youth Anxiety Differ Across Research and Practice Settings?

Development and Initial Psychometrics for a Therapist Competence Instrument for CBT for Youth Anxiety

Do clinical experience, formal cognitive behavioural therapy training, adherence, and competence predict outcome in cognitive behavioural therapy for anxiety disorders in youth?

Barriers to and Facilitators in the Implementation of Cognitive-Behavioral Therapy for Youth Anxiety in the Community

A comparison of scalable routine clinical materials and observer ratings to assess CBT fidelity

Effectiveness of CBT Versus Standard Treatment for Childhood Anxiety Disorders in a Community Clinic Setting

Cognitive Behavioral Therapy in Practice: Treatment Delivered by Trainees at an Outpatient Clinic Is Clinically Effective

Training and Consultation to Promote Implementation of an Empirically Supported Treatment: A Randomized Trial

A Randomized Clinical Trial Comparing Individual Cognitive Behavioral Therapy and Child-Centered Therapy for Child Anxiety Disorders

Adapting CBT for youth anxiety: Flexibility, within fidelity, in different settings

Assessing fidelity to family-based treatment: an exploratory examination of expert, therapist, parent, and peer ratings

Brief Cognitive-Behavioral Therapy for Anxious Youth: Feasibility and Initial Outcomes

Applying Group Cognitive Behavioral Therapy for Anxiety Disorders in Community Settings: Retention, Outcome, and Clinical Considerations

Assessing practical implementation of modular psychotherapy for youth in community-based settings using benchmarking

Moderators of Response to Personalized and Standard Care Cognitive-Behavioral Therapy for Youth with Autism Spectrum Disorder and Comorbid Anxiety

Predicting CBT modality, treatment participation, and reliable improvements for individuals with anxiety and depression in a specialized mental health centre: a retrospective population-based cohort study

Quality of cognitive-behavioural therapy in routine psychiatric care: therapist adherence and competence, and patient outcomes for depression and anxiety disorders

Consultants’ Perceptions of School Counselors’ Ability to Implement an Empirically-Based Intervention for Adolescent Social Anxiety Disorder

Long-Term Effectiveness of Cognitive Behavioral Therapy in Routine Outpatient Care for Youth with Anxiety Disorders