Abstract:Digital literacy is essential for scientific literacy in a digital world. Although the NGSS Practices include many activities that require digital literacy, most studies have examined digital literacy from a generic perspective rather than a curricular context. This study aimed to develop a self-report tool to measure elements of digital literacy among middle and high school students in the context of science practice. Using Messick's validity framework, Rasch analysis was conducted to ensure the tool's validity. Initial items were developed from the NGSS, KSES, and other countries' curricula and related research literature. The final 38 items were expertly reviewed by scientists and applied to 1194 students for statistical analysis. The results indicated that the tool could be divided into five dimensions of digital literacy in the context of science practice: collecting and recording data, analyzing and interpreting (statistics), analyzing and interpreting (tools), generating conclusions, and sharing and presenting. Item fit and reliability were analyzed. The study found that most items did not show significant gender or school level differences, but scores increased with grade level. Boys tended to perform better than girls, and this difference did not change with grade level. Analysis and Interpretation (Tools) showed the largest differences across school levels. The developed measurement tool suggests that digital literacy in the context of science practice is distinct from generic digital literacy, requiring a multi-contextual approach to teaching. Furthermore, the gender gap was evident in all areas and did not decrease with higher school levels, particularly in STEM-related items like math and computational languages, indicating a need for focused education for girls. The tool developed in this study can serve as a baseline for teachers to identify students' levels and for students to set learning goals. It provides information on how digital literacy can be taught within a curricular context.

Validity and reliability of eight-grade digital culture test in light of item response theory

Development of a digital literacy measurement tool for middle and high school students in the context of scientific practice

Validation Study of Digital Literacy Assessment Scale for Elementary School Teachers

Comparative Study on Validity of Paper-Based Test and Computer-Based Test in the Context of Educational and Psychological Assessment among Arab Students

Item Analysis of a Reading Test in a Sri Lankan Context using Classical Test Theory

Development of Number Sense Test for Eighth-Grade Students: A Validity and Reliability Study

ASSESSING THE VALIDITY AND RELIABILITY OF SCIENCE MULTIPLE CHOICE TEST USING RASCH DICHOTOMOUS MEASUREMENT MODEL

Reliability and Construct Validity of Computational Thinking Scale for Junior High School Students: Thai Adaptation

Developing an Achievement Test about 7th Grade “Solar System and Beyond” Unit: Analysis of Validity and Reliability

Item response analysis of computational thinking practices: Test characteristics and students’ learning abilities in visual programming contexts

High Order Thinking Skills and Digital Literacy Skills Instrument Test

Developing a digital competence scale for teachers: validity and reliability study

The role of age, grade level, and subject area in determining the inclusion of digital citizenship elements in elementary school curricula: Perspectives of teachers in the Kingdom of Saudi Arabia

The Design and Validation of A Tool to Measure Content Validity of A Computational thinking Game-Based Learning Module for Tertiary Educational Students

Development and validation of the intention to report child abuse tool: A psychometric research study

Teachers' digital competences: a scale construction and validation study

Developing the Critical Thinking Skill Test for High School Students: A Validity and Reliability Study

Analysis of Content Validity on Mathematical Computational Thinking Skill Test for Junior High School Student Using Aiken Method

The competent Computational Thinking test (cCTt): Development and validation of an unplugged Computational Thinking test for upper primary school

Construct validity of the instrument of digital skill literacy

Computerized testing in reading comprehension skill: investigating score interchangeability, item review, age and gender stereotypes, ICT literacy and computer attitudes