Abstract:Background: The eHealth Literacy Scale (eHEALS) was introduced in China in 2013 as one of the most important electronic health literacy measurement instruments. After a decade of development in China, it has received widespread attention, although its theoretical underpinnings have been challenged, thus demanding more robust research evidence of factorial validity and multigroup measurement properties. Objective: This study aimed to evaluate the Chinese version of the eHEALS in terms of its measurement properties. Methods: A cross-sectional survey was conducted in a university setting in China. Item statistics were checked for response distributions and floor and ceiling effects. Internal consistency reliability was confirmed with Cronbach α, split-half reliability, Cronbach α if an item was deleted, and item-total correlation. A total of 5 representative eHEALS factor structures were examined and contrasted using confirmatory factor analysis. The study used the item-level content validity index (I-CVI) and the average of the I-CVI scores of all items on the scale to assess the content validity of the dominance model. Furthermore, the validated dominance model was subsequently used to evaluate the relevance and representation of elements in the instrument and to assess measurement invariance across genders. Results: A total of 972 respondents were identified, with a Cronbach α of .92, split-half reliability of 0.88, and item-total score correlation coefficients ranging from 0.715 to 0.781. Cronbach α if an item was deleted showed that all items should be retained. Acceptable content validity was supported by I-CVIs ≥0.80. The confirmatory factor analysis confirmed that the 3-factor model was acceptable. The measurement model met all relevant fit indices: average variance extracted from 0.663 to 0.680, composite reliability from 0.810 to 0.857, chi-square divided by the df of 4.768, root mean square error of approximation of 0.062, standardized root mean squared residual of 0.020, comparative fit index (CFI) of 0.987, and Tucker-Lewis index of 0.979. In addition, the scale demonstrated error variance invariance (Δnormed fit index=-0.016, Δincremental fit index=-0.012, ΔTucker-Lewis index=0.005, Δcomparative fit index=-0.012, Δrelative fit index=0.005, and Δroot mean square error of approximation=0.005). Conclusions: A 3-factor model of the Chinese version of the eHEALS fits best, and our findings provide evidence for the strict measurement invariance of the instrument regarding gender.

Item Response Theory Analysis and Measurement Invariance Testing of the Cultural Humility and Enactment Scale

Item Response Theory Analysis of the Cultural Humility and Enactment Scale – Supervision

Examining the Structure, Reliability, and Validity of the Chinese Personal Growth Initiative Scale–II: Evidence for the Importance of Intentional Self-Change among Chinese

Factorial Invariance of the Questionnaire about Interpersonal Difficulties for Adolescents Across Spanish and Chinese Adolescent Samples

Measurement invariance of language brokering extent and attitudes in linguistic minority adolescents: Item response theory analyses.

Measuring Environmental Concern Through International Surveys: A Study of Cross-Cultural Equivalence with Item Response Theory and Confirmatory Factor Analysis

Structural Validation and Measurement Invariance Testing of the Chinese Version of the eHealth Literacy Scale Among Undergraduates: Cross-Sectional Study

The Revision of the Personal Need for Structure Scale in Chinese

Validation of the Personal Need for Structure Scale in Chinese.

Health behavior inventory - short form: a Chinese validation study using classical test theory and item response theory

Comparison of Trust Assessment Scales Based on Item Response Theory

Factor structure and measurement invariance of the Health Education Impact Questionnaire: Does the subjectivity of the response perspective threaten the contextual validity of inferences?

Measuring Creative Self-Efficacy: An Item Response Theory Analysis of the Creative Self-Efficacy Scale

The development and validation of the Chinese safety climate scale using the item-response theory approach

Structure and Longitudinal Invariance of the Multicultural Awareness, Knowledge, and Skills Survey – Counselor Edition – Revised

The item structure of the Eysenck Personality Questionnaire across method and culture

Item analysis and differential item functioning of a brief conduct problem screen.

Comparing Attitudes Across Groups: An IRT-Based Item-Fit Statistic for the Analysis of Measurement Invariance

The application of item response theory in developing and validating a shortened version of the Rotterdam Emotional Intelligence Scale

Emotion Regulation Questionnaire for Cross-Gender Measurement Invariance in Chinese University Students

Item Response Theory -- A Statistical Framework for Educational and Psychological Measurement