Abstract:Children with autism spectrum disorder benefit from early, intensive interventions to improve social communication, and parent-implemented interventions are a feasible, family-centered way to increase treatment dosage. The success of such interventions is dependent on a parent’s ability to implement the strategies with fidelity. However, measurement of parent strategy use varies across studies. Most studies use one of two types of observational coding measures (macro- and micro-codes). Macro-codes are known for being efficient while micro-codes are known for being precise. This study evaluates the reliability and validity of the NDBI-Fi, a macro-code, compared to a micro-code. Parent–child interaction videos for 177 participants were used to compare these measures. Results demonstrated that the NDBI-Fi had strong inter-rater reliability. It also had strong convergent validity with the micro-code after intervention. In addition, the NDBI-Fi was sensitive to change, and it demonstrated precision comparable to the micro-code. Furthermore, a novel scoring procedure detected differences in parents who learned different intervention strategy types. However, the NDBI-Fi did not demonstrate strong validity before intervention, particularly when measuring responsive intervention strategies. Taken together, findings support the use of the NDBI-Fi as an outcome measure, and future work should focus on continued development of valid pre-intervention macro-codes. Lay abstract Children with autism spectrum disorder benefit from early intervention to improve social communication, and parent-implemented interventions are a feasible and family-centered way to increase the amount of treatment they receive. For these treatments to be effective, it is important for the parent to implement the strategies as intended. However, measurement of parent strategy use is inconsistent across studies of parent-implemented interventions. This study evaluates the quality of the NDBI-Fi, an efficient measure, compared to a more time-consuming measure that is known to be precise. Videos of parents playing with their children were used to compare these two measurement methods. Results demonstrated that the NDBI-Fi was of good quality: scorers had high levels of agreement, the NDBI-Fi was similar to the more precise measure in rating parents after intervention, it detected changes from before to after intervention, and it detected differences when parents learned different types of intervention strategies. The NDBI-Fi was not as precise as the other measure across all strategies before parents learned intervention. Taken together, the findings of this study support the use of the NDBI-Fi as a high-quality outcome measure.

Fidelity of implementation of activity-based intervention in daycare

Quality Improvement Process in Childcare Facilities: Results of a Qualitative Study

Evaluating fidelity in home-visiting programs a qualitative analysis of 1058 home visit case notes from 105 families

A mixed-methods investigation of early childhood professional development for providers and recipients in the United States

Caregiver Intervention Implementation Fidelity: An Empirical Investigation of a Multidimensional Model

The Effectiveness of Coursework and Onsite Coaching at Improving the Quality of Care in Infant–Toddler Settings

Implementation of Naturalistic Developmental Behavioral Intervention Strategies: An Examination of Preschool Teachers’ Perceptions

Considering the implementation research-to-practice gap: An experimental evaluation of intervention-general methods for assessing and supporting intervention fidelity through coaching

A Treatment Integrity Analysis of Function-Based Intervention

Measuring parent strategy use in early intervention: Reliability and validity of the Naturalistic Developmental Behavioral Intervention Fidelity Rating Scale across strategy types

Organizational readiness and implementation fidelity of an early childhood education and care-specific physical activity policy intervention: findings from the Play Active trial

Preschool Teachers’ Implementation Fidelity When Using a Technology-Mediated Language and Literacy Intervention

Inclusion in Quebec childcare centers: financial support, adaptation, and training

Theory and theory-driven practices of Activity Based Intervention.

A review of research on fidelity of implementation: implications for drug abuse prevention in school settings.

Teaching Parents Enhanced Milieu Teaching With Words and Signs Using the Teach-Model-Coach-Review Model

Building the Capacity of Family Day Care Educators to Promote Children's Social and Emotional Wellbeing: Results of an Exploratory Cluster Randomised-Controlled Trial

Changes in the practices in make-believe play situations of one kindergarten teacher participating in an activity-oriented professional development program

Community implementation of a brief parent mediated intervention for toddlers with probable or confirmed autism spectrum disorder: feasibility, acceptability, and drivers of success (IE Drmic et al.)

Seeking Validation and Creating Meaningful Interactions

The Case for Assessing and Reporting on Facilitator Fidelity: Introducing the Fidelity of Implementation in Parenting Programs Guideline