Abstract:Background: Although some advances have been made in recent years, the lack of measures remains a major challenge in the field of implementation research. This results in frequent adaptation of implementation measures for different contexts-including different types of respondents or professional roles-than those for which they were originally developed and validated. The psychometric properties of these adapted measures are often not rigorously evaluated or reported. In this study, we examined the internal consistency, factor structure, and structural invariance of four well-validated measures of inner setting factors across four groups of respondents. The items in these measures were adapted as part of an evaluation of a large-scale organizational change in a rehabilitation hospital, which involved transitioning to a new building and a new model of patient care, facilitated by a significant redesign of patient care and research spaces. Methods: Items were tailored for the context and perspective of different respondent groups and shortened for pragmatism. Confirmatory factor analysis was then used to test study hypotheses related to fit, internal consistency, and invariance across groups. Results: The survey was administered to approximately 1208 employees; 785 responded (65% response rate) across the roles of clinician, researcher, leader, support staff, or dual clinician and researcher. For each of the four scales, confirmatory factor analysis demonstrated adequate fit that largely replicated the original measure. However, a few items loaded poorly and were removed from the final models. Internal consistencies of the final scales were acceptable. For scales that were administered to multiple professional roles, factor structures were not statistically different across groups, indicating structural invariance. Conclusions: The four inner setting measures were robust for use in this new context and across the multiple stakeholder groups surveyed. Shortening these measures did not significantly impair their measurement properties; however, as this study was cross sectional, future studies are required to evaluate the predictive validity and test-retest reliability of these measures. The successful use of adapted measures across contexts, across and between respondent groups, and with fewer items is encouraging, given the current emphasis on designing pragmatic implementation measures.

Measuring performance in allied health professional role substitution models of care: a clinician survey

Unlocking potential: a qualitative exploration guiding the implementation and evaluation of professional role substitution models in healthcare

Evaluating allied health primary contact models of care: A mixed methods analysis of current practice

Assisting allied health in performance evaluation: a systematic review

Performance Evaluation of a Health Insurance in Nigeria Using Optimal Resource Use: Health Care Providers Perspectives

‘The big value of it is getting the patient seen by the right person at the right time’: clinician perceptions of the value of allied health primary contact models of care

Measures to assess the performance of an Australian non-government charitable non-acute health service: A Delphi Survey of Organisational Stakeholders

Measuring the overall performance of mental healthcare providers

Primary Care 2.0: A Prospective Evaluation of a Novel Model of Advanced Team Care With Expanded Medical Assistant Support

Innovative models of care for the health facility of the future: a protocol for a mixed-methods study to elicit consumer and provider views

Experiences of registered nurses supporting nursing students during clinical placement using a facility-based model: A mixed methods study

A qualitative investigation of the Additional Roles Reimbursement Scheme in primary care

Assessment and remediation for physicians with suspected performance problems: an international survey

Setting the context for a complex dental intervention of role substitution in care homes: Initial process evaluation findings

A New Tool to Assess Clinician Experience With Patient Care Transitions

Pragmatic adaptation of implementation research measures for a novel context and multiple professional roles: a factor analysis study

Patients' experiences of and roles in interprofessional collaborative practice in primary care: a constructivist grounded theory study

Alignment Between Objective and Subjective Assessments of Health System Performance: Findings From a Mixed-Methods Study

Rapid Prototyping Model for Healthcare Alternative Payment Models: Replicating the Federally Qualified Health Center Advanced Primary Care Practice Demonstration

A systematic review of the effectiveness of strategies to improve health care provider performance in low- and middle-income countries: Methods and descriptive results

Health professionals' attitudes and practices in relation to Functional Capacity Evaluations