Abstract:Background: Implementation support practitioners (ISPs) are professionals that support others to implement evidence-informed practices, programs, and policies in various service delivery settings to achieve population outcomes. Measuring the use of competencies by ISPs provides a unique opportunity to assess an understudied facet of implementation science-how knowledge, attitudes, and skills used by ISPs affects sustainable change in complicated and complex service systems. This study describes the development and validation of a measure-the Implementation Support Competencies Assessment (ISCA)-that assesses implementation support competencies, with versatile applications across service contexts. Methods: Recently developed practice guide materials included operationalizations of core competencies for ISPs across three domains: co-creation and engagement, ongoing improvement, and sustaining change. These operationalizations, in combination with recent empirical and conceptual work, provided an initial item pool and foundation on which to advance measurement development, largely from a confirmatory perspective (as opposed to exploratory). The measure was further refined through modified cognitive interviewing with three highly experienced ISPs and pilot-testing with 39 individuals enrolled in a university-based certificate program in implementation practice. To recruit a sample for validation analyses, we leveraged a listserv of nearly 4,000 individuals who have registered for or expressed interest in various events and trainings focused on implementation practice offered by an implementation science collaborative housed within a research-intensive university in the Southeast region of the United States. Our final analytic sample included 357 participants who self-identified as ISPs. Results: Assessments of internal consistency reliability for each competency-specific item set yielded evidence of strong reliability. Results from confirmatory factor analyses provided evidence for the factorial and construct validity of all three domains and associated competencies in the ISCA. Conclusions: The findings suggest that one's possession of high levels of competence across each of the three competency domains is strongly associated with theorized outcomes that can promote successful and sustainable implementation efforts among those who receive implementation support from an ISP. The ISCA serves as a foundational tool for workforce development to formally measure and assess improvement in the skills that are required to tailor a package of implementation strategies situated in context.

School Counselor Transgender Intersex Advocacy Competence Scale (SCTIACS): Construction and Validation

Translation, Revision and Assessment of Reliability and Validity of the Assessment of Interprofessional Team Collaboration Scale

Counselor Competence Gender Identity Scale: Measuring Clinical Bias, Knowledge, and Skills

Development and validation of the Transgender Adolescent Stress Survey-Dysphoria

Development and Initial Validation of the Counselor Self-Reflection Inventory for Counselors and Counselors-in-Training

Development and Initial Validation of the Climate Change Counseling Scale

ACTing As Yourself: Implementing Acceptance and Commitment Therapy for Transgender Adolescents Through a Developmental Lens

Validation in Spanish and English of the Transgender Inclusive Behavior Scale

The School Counselor Leadership Survey: Instrument Development and Exploratory Factor Analysis

Development and Psychometric Evaluation of the Gender Identity Scale for Transgender Women in China

Development and Evaluation of the Atheist Identity Concealment Scale (AICS)

ISPCAN Child Abuse Screening Tool Children's Version (ICAST-C): Instrument development and multi-national pilot testing

Trauma-informed climate scale-10 and attitudes related to trauma-informed care-10: An examination of scale psychometrics using data from disability service providers

Validation and standardization of the Childhood Trauma Screener (CTS) in the general population

Autism Spectrum Disorder and Anxiety Among Transgender Youth: Use of the Social Communication Questionnaire (SCQ)

Development and psychometric evaluation of the Implementation Support Competencies Assessment

Assessing the Professional Personality of College Counselors: A Student-Oriented Psychological Scale

Development and validation of the Japanese version of the Lesbian, Gay, Bisexual, and Transgender Development of Clinical Skills Scale

Development of a social cognitive career theory scale for measuring the intention to select surgery as a career

Assessing treatment integrity in personalized CBT: the inventory of therapeutic interventions and skills

The Development and Validation of the Child Sexual Assault Victim Credibility Scale: An Instrument to Measure Laypersons’ Perceptions of Victim Credibility