Abstract:Observational coding is the gold standard for coding treatment fidelity in Cognitive Behavioral Therapy (CBT). This method allows researchers to objectively assess therapist behaviors to determine if CBT was delivered as intended. However, there is no standard method or protocol that ensures reliability within and between research groups, compromising comparability between studies. The aim of this study was to evaluate procedures used to train raters to quantify CBT fidelity. A systematic review was conducted. PsycINFO and Web of Science databases were reviewed for articles up until July 2015; the parameters of the search included CBT, depression, treatment fidelity, and coding/rating. A total of 521 articles were screened for inclusion, which yielded 81 articles. Data was extracted across four categories (study characteristics, training process, inter-rater reliability, and rating), and 62 codes. The results revealed variability in training approaches (e.g., 25.9% of articles reported 10–50 h of training). Very little information was provided about the training process (i.e. only one study specified training duration). Training materials were: manuals (21.0%), videos (18.5%), audiotapes (2.4%), readings (1.2%), and lectures (1.2%). Almost all (90.1%) studies did not describe the trainer, and 28.4% did not describe raters. The relation between CBT fidelity and clinical outcomes is equivocal, perhaps because intra-team and inter-team reliability is difficult to achieve. This systematic review revealed variability in training others to rate CBT fidelity, of which some approaches might inform the field for future use.

The Training and Validation of Behavior Observation and Description Skills

Using Behavioral Skills Training to Teach Functional Assessment Interviewing, Cultural Responsiveness, and Empathic and Compassionate Care to Students of Applied Behavior Analysis

Behavioral skills training to teach pre-service elementary general educators to conduct descriptive assessments

Developing and Validating an Observational Learning Model of Computer Software Training and Skill Acquisition

Direct behavioral observation in school settings: Bringing science to practice

Evaluation of a training package to teach pairing procedures

Assessing Teachers’ Behavior Support Skills

Long‐term effectiveness and generality of practical functional assessment and skill‐based treatment

Four Observation Categories for Rating Teacher Behavior

Psychometric Properties of the Behavior Assessment System for Children Student Observation System (BASC-3 SOS) with Young Children in Special Education

Measuring Change in Social Interaction Skills of Young Children with Autism

[The BASYS observation system for the analysis of aggressive behavior in classroom-settings]

A Two Experiment Treatment Comparison Study: Teaching Social Skills to Children with Autism Spectrum Disorder

The Behavior Observation Scale for Autism: Initial Methodology, Data Analysis, and Preliminary Findings on 89 Children

A Proposed Model for Selecting Measurement Procedures for the Assessment and Treatment of Problem Behavior

Observational Coding Training Methods for CBT Treatment Fidelity: A Systematic Review

Teaching Vocational and Social Skills to Adolescents with Autism Using Video Modeling

In vivo functional assessment and multi-element interventions for problem behaviors of students with disabilities in classroom settings

Social Skills Training for Youth with Autism Spectrum Disorders

Use of Interview and Observation to Clarify Reported Practices of Head Start Staff Concerning Problem Behavior

An Observation Procedure for Assessing Children's Social Behaviours in Free Play Settings