Abstract:Purpose: Instructional designs promoting personalization (conversational style and visible author), embodiment (human-like mannerisms and presence), and social and cognitive congruence have been shown to enhance learning. However, measurements of these instructional design features are lacking. The authors sought to develop and validate an instrument to measure personalization, embodiment, and congruence in an online course, collecting evidence of content, internal structure, and relationships with other variables. Method: Through literature review, expert review, and pilot testing, the authors developed a 15-item, 5-domain instrument. Participants completed this instrument along with assessments of motivation (Instructional Materials Motivation Survey and Motivated Strategies for Learning Questionnaire), knowledge, and course satisfaction immediately after a 30-minute online multimedia learning module comprising slides with voiceover and (for some participants) short video clips, from January to April 2021. Participants included pharmacists, physicians, and advanced practice providers at academic and community hospitals. Confirmatory factor analysis (CFA) was used to examine model fit, followed by structural revisions guided by exploratory factor analysis (EFA) and tested in a new CFA using a split-sample approach. The authors evaluated associations between the revised instrument scores and motivation, knowledge, and satisfaction. Results: There were 406 participants. CFA of the original 15-item instrument revealed poor model fit. EFA using 214 randomly selected participants suggested a 2-domain structure. CFA of the revised structure using the other 192 participants revealed good fit for a 9-item, 2-domain instrument: the Congruence-Personalization Questionnaire (CPQ). Linear regression confirmed positive, statistically significant associations for most hypothesized relationships (R 2 ≥ 0.12 and P < .001 for 14 of 18 associations with motivation and satisfaction). Associations with knowledge were weak and nonsignificant (R 2 ≤ 0.004, P > .23). Conclusions: Evidence of content, internal structure, and relationships with other variables support the validity of CPQ scores for measuring personalization and congruence in an online module.

The Measurement of Perceived Relationship Quality Components: A Confirmatory Factor Analytic Approach

A Novel, Network-Based Approach to Assessing Romantic-Relationship Quality

Testing the ruler with item response theory: Increasing precision of measurement for relationship satisfaction with the Couples Satisfaction Index.

Psychometric Evaluation of Single-Item Relationship Satisfaction, Love, Conflict, and Commitment Measures

Relational Climate in the Workplace: Dimensions, Measurement, and Validation

Toward an optimized measure of perceived partner responsiveness: Development and validation of the perceived responsiveness and insensitivity scale.

Measuring the Impact of Technology on Couple Relationships: The Development of the Technology and Intimate Relationship Assessment

Validating a brief measure of four facets of social evaluation

Matches Made With Information: Fitting Measurement Models to Adult Attachment Data

Validation of the Relationships Questionnaire (RQ) against the Experience of Close Relationship-Revised Questionnaire in a Clinical Psychiatric Sample

Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations

Measuring Personalization, Embodiment, and Congruence in Online Learning: A Validation Study

Development and Validation of Two New Brand Love Scales

Construction and Validation of Quality Measurement Model of Doctor-Patient Relationship Based on Structural Equation Model

The five and seven factors personality models: differences and similitude between the TCI-R, NEO-FFI-R and ZKPQ-50-CC

Development of a Structure-Validated Family Relationship Questionnaire (FRQ) with Chinese University Students

Measuring Service Quality: A Reexamination and Extension

Psychometric Properties of the Basic Needs Satisfaction in General Scale: A Second-Order CFA Analysis

Bayesian and Maximum-Likelihood Modeling and Higher-Level Scores of Interpersonal Problems With Circumplex Structure

Refining the assessment of need supportive and need thwarting interpersonal behaviors using the bifactor exploratory structural equation modeling framework

Psychometric approaches for developing commensurate measures across independent studies: Traditional and new models.