Abstract:Background The World Wide Web has become an essential source of health information. Nevertheless, the amount and quality of information provided may lead to information overload. Therefore, people need certain skills to search for, identify, and evaluate information from the internet. In the context of health information, these competencies are summarized as the construct of eHealth literacy. Previous research has highlighted the relevance of eHealth literacy in terms of health-related outcomes. However, the existing instrument assessing eHealth literacy in the German language reveals methodological limitations regarding test development and validation. The development and validation of a revised scale for this important construct is highly relevant. Objective The objective of this study was the development and validation of a revised German eHealth literacy scale. In particular, this study aimed to focus on high methodological and psychometric standards to provide a valid and reliable instrument for measuring eHealth literacy in the German language. Methods Two internationally validated instruments were merged to cover a wide scope of the construct of eHealth literacy and create a revised eHealth literacy scale. Translation into the German language followed scientific guidelines and recommendations to ensure content validity. Data from German-speaking people (n=470) were collected in a convenience sample from October to November 2020. Validation was performed by factor analyses. Further, correlations were performed to examine convergent, discriminant, and criterion validity. Additionally, analyses of measurement invariance of gender, age, and educational level were conducted. Results Analyses revealed a 2-factorial model of eHealth literacy. By item-reduction, the 2 factors information seeking and information appraisal were measured with 8 items reaching acceptable-to-good model fits (comparative fit index [CFI]: 0.942, Tucker Lewis index [TLI]: 0.915, root mean square error of approximation [RMSEA]: 0.127, and standardized root mean square residual [SRMR]: 0.055). Convergent validity was comprehensively confirmed by significant correlations of information seeking and information appraisal with health literacy, internet confidence, and internet anxiety. Discriminant and criterion validity were examined by correlation analyses with various scales and could partly be confirmed. Scalar level of measurement invariance for gender (CFI: 0.932, TLI: 0.923, RMSEA: 0.122, and SRMR: 0.068) and educational level (CFI: 0.937, TLI: 0.934, RMSEA: 0.112, and SRMR: 0.063) were confirmed. Measurement invariance of age was rejected. Conclusions Following scientific guidelines for translation and test validation, we developed a revised German eHealth Literacy Scale (GR-eHEALS). Our factor analyses confirmed an acceptable-to-good model fit. Construct validation in terms of convergent, discriminant, and criterion validity could mainly be confirmed. Our findings provide evidence for measurement invariance of the instrument regarding gender and educational level. The newly revised GR-eHEALS questionnaire represents a valid instrument to measure the important health-related construct eHealth literacy.

Receptivity to Instructional Computer-Based Feedback (RIF)

Measuring attitudes towards interprofessional learning. Testing two German versions of the tool "Readiness for Interprofessional Learning Scale" on interprofessional students of health and nursing sciences and of human medicine

Lacking measurement invariance in research self-efficacy: Bug or feature?

Measuring the Computer-Related Self-Concept

Adapting a self-efficacy scale to the task of teaching scientific reasoning: collecting evidence for its psychometric quality using Rasch measurement

Multimethod assessment of self-regulated learning in college students: different methods for different components?

The application of item response theory in developing and validating a shortened version of the Rotterdam Emotional Intelligence Scale

Measuring Electronic Health Literacy: Development, Validation, and Test of Measurement Invariance of a Revised German Version of the eHealth Literacy Scale

Validating the Multi-Dimensional Structure of Self-Efficacy Beliefs in Peer Feedback for L2 Writing: A Bifactor-Exploratory Structural Equation Modeling Approach

A new measure for the revised reinforcement sensitivity theory: psychometric criteria and genetic validation

The factor structure of the peer-feedback orientation scale (PFOS): toward a measure for assessing students’ peer-feedback dispositions

Assessing the desire for aesthetics: Adaptation and validation of the desire for aesthetics scale in German (DFAS-G)

Developing a scale to explore self-regulatory approaches to assessment and feedback with academics in higher education

Adaptation and reliability of the readiness for inter professional learning scale (RIPLS) in the Chinese health care students setting

Measuring dysfunctional interpersonal beliefs: validation of the Interpersonal Cognitive Distortions Scale among a heterogeneous German-speaking sample

Development and validation of the ICT motivation scale for young adolescents. Results of the international school assessment study ICILS 2013 in Germany

Constructing and validating a self-assessment scale for Chinese college English-major students’ feedback knowledge repertoire in EFL academic writing: Item response theory and factor analysis approaches

Assessing L2 integrated writing self-efficacy: Development and validation of a scale

Perceived Classroom Responsibility Climate Questionnaire: A new scale

Reading the Mind in the Eyes of Children Test (RME-C-T): Development and Validation of a Complex Emotion Recognition Test