Abstract:Background: Achieving high quality outcomes in a community context requires the strategic coordination of many activities in a service system, involving families, clinicians, supervisors, and administrators. In modern implementation trials, the therapy itself is guided by a treatment manual; however, structured supports for other parts of the service system may remain less well-articulated (e.g., supervision, administrative policies for planning and review, information/feedback flow, resource availability). This implementation trial investigated how a psychosocial intervention performed when those non-therapy supports were not structured by a research team, but were instead provided as part of a scalable industrial implementation, testing whether outcomes achieved would meet benchmarks from published research trials. Method: In this single-arm observational benchmarking study, a total of 59 community clinicians were trained in the Modular Approach to Therapy for Children (MATCH) treatment program. These clinicians delivered MATCH treatment to 166 youth ages 6 to 17 naturally presenting for psychotherapy services. Clinicians received substantially fewer supports from the treatment developers or research team than in the original MATCH trials and instead relied on explicit process management tools to facilitate implementation. Prior RCTs of MATCH were used to benchmark the results of the current initiative. Client improvement was assessed using the Top Problems Assessment and Brief Problem Monitor. Results: Analysis of client symptom change indicated that youth experienced improvement equal to or better than the experimental condition in published research trials. Similarly, caregiver-reported outcomes were generally comparable to those in published trials. Conclusions: Although results must be interpreted cautiously, they support the feasibility of using process management tools to facilitate the successful implementation of MATCH outside the context of a formal research or funded implementation trial. Further, these results illustrate the value of benchmarking as a method to evaluation industrial implementation efforts.Plain Language Summary: Randomized effectiveness trials are inclusive of clinicians and cases that are routinely encountered in community-based settings, while continuing to rely on the research team for both clinical and administrative guidance. As a result, the field still struggles to understand what might be needed to support sustainable implementation and how interventions will perform when brought to scale in community settings without those clinical trial supports. Alternative approaches are needed to delineate and provide the clinical and operational support needed for implementation and to efficiently evaluate how evidence-based treatments perform. Benchmarking findings in the community against findings of more rigorous clinical trials is one such approach. This paper offers two main contributions to the literature. First, it provides an example of how benchmarking is used to evaluate how the Modular Approach to Therapy for Children (MATCH) treatment program performed outside the context of a research trial. Second, this study demonstrates that MATCH produced comparable symptom improvements to those seen in the original research trials and describes the implementation strategies associated with this success. In particular, although clinicians in this study had less rigorous expert clinical supervision as compared with the original trials, clinicians were provided with process management tools to support implementation. This study highlights the importance of evaluating the performance of intervention programs when brought to scale in community-based settings. This study also provides support for the use of process management tools to assist providers in effective implementation.

Clinical and scientific implications of Project MATCH

Matching alcoholism treatments to client heterogeneity: treatment main effects and matching effects on drinking during treatment. Project MATCH Research Group.

Therapist-Level Moderators of Patient-Therapist Match Effectiveness in Community Psychotherapy

Measurement-based matching of patients to psychotherapists' strengths.

The modular approach to therapy for youths with anxiety, depression, trauma, and conduct problems (MATCH): results from the Norwegian randomized-controlled trial

The Effect of Intervention Preference Matching on Outcomes and Engagement in a Post-cessation Weight Management Trial

Evaluating Modular Approach to Therapy for Children with Anxiety, Depression, Trauma and Conduct Problems (MATCH-ADCT) in Norwegian child and adolescent outpatient clinics: Study protocol for a randomized controlled trial

Modular Approach to Therapy for Anxiety, Depression, Trauma, or Conduct Problems in outpatient child and adolescent mental health services in New Zealand: study protocol for a randomized controlled trial

Implementing Approach-Bias Modification as Add-On to Varieties of Clinical Treatment for Alcohol Use Disorders: Results of a Multicenter RCT

Evaluating a Modular Approach to Therapy for Children With Anxiety, Depression, Trauma, or Conduct Problems (MATCH) in School-Based Mental Health Care: Study Protocol for a Randomized Controlled Trial

Provider Adherence to Modular Cognitive Behavioral Therapy for Children and Adolescents

Matching Bounds: How Choice of Matching Algorithm Impacts Treatment Effects Estimates and What to Do about It

A meta-analysis of cognitive-behavioral therapy for alcohol or other drug use disorders: Treatment efficacy by contrast condition.

Impact of NCI-MATCH: a Nationwide Oncology Precision Medicine Trial

Assessing practical implementation of modular psychotherapy for youth in community-based settings using benchmarking

Effectiveness of the Korean-Patient Placement Criteria for Alcohol Use Disorders: A Prospective Exploratory Study

The Twelve Promises of Alcoholics Anonymous: psychometric measure validation and mediational testing as a 12-step specific mechanism of behavior change

Enduring effects of a computer-assisted training program for cognitive behavioral therapy: A 6-month follow-up of CBT4CBT

Using conventional and machine learning propensity score methods to examine the effectiveness of 12-step group involvement following inpatient addiction treatment

A Digital Cognitive Behavioral Therapy Program for Adults With Alcohol Use Disorder: A Randomized Clinical Trial

Do improvements in motivational language predict alcohol use in motivational interviewing? Ambivalence matters