Abstract:Computational thinking (CT) has permeated primary and early childhood education in recent years. Despite the extensive effort in CT learning initiatives, few age-appropriate assessment tools targeting young children have been developed. In this study, we proposed Computational Thinking Test for Lower Primary (CTtLP), which was designed for lower primary school students (aged 6–10). Based on the evidence-centred design approach, a set of constructed-response items that are independent of programming platforms was developed. To validate the test, content validation was first performed via expert review and cognitive interviews, and refinements were made based on the comments. Then, a large-scale field test was administered with a sample of 1st–3rd graders (N = 1225), and the data was used for psychometric analysis based on both classical test theory (CTT) and item response theory (IRT). The CTT results provided robust criterion validity, internal consistency, and test–retest reliability values. Regarding IRT results, a three-parameter logistic model was selected according to the item fit indices, based on which fair item parameters and test information reliability were generated. Overall, the test items and the whole scale showed proper fit, suggesting that CTtLP was a suitable test for the target group. Analyses of the test performance were then put forward. Results reported that students' performance improved with grade level, and no gender difference was detected. Based on the test responses, we also identified children's challenges in understanding CT constructs, indicating that students tended to have difficulty in understanding loop control and executing multiple directions. The study provides a rigorously validated diagnostic test for measuring CT acquisition in lower primary school students and demonstrates a replicable design and validation process for future assessment practices, and findings on the difficulties children faced in CT conceptual understanding could shed light on CT primary and early childhood education.

Development and validation of a two‐tier number sense test for sixth‐grade students in fractions and decimals

Development of Number Sense Test for Eighth-Grade Students: A Validity and Reliability Study

Developmental Trajectories of Numerical Magnitude Representations of Fractions and Decimals.

Development of a digital literacy measurement tool for middle and high school students in the context of scientific practice

An Examination of Fourth-Grade Elementary School Students’ Number Sense in Context-Based and Non-Context-Based Problems

The Development of HOTS (Higher-Order Thinking Skills) Assessment Instrument Based on Numeration Literacy in Mathematics for Junior High School

Development of a numeracy literacy ability test instrument based on high order thinking skills (hots) in junior high school mathematics learning

Sixth Grade Students’ Performance, Misconception, and Confidence on a Three-Tier Number Sense Test

Gifted students' number sense skills in terms of number sense components

Number Sense Across the Transition from Preschool to Elementary School: A Latent Profile Analysis

Development and validation of a computational thinking test for lower primary school students

The competent Computational Thinking test (cCTt): Development and validation of an unplugged Computational Thinking test for upper primary school

6th grade science ability test validity and reliability research

Determining the psychometric properties of middle school statistical thinking testlet-based assessment tool

Exploring the impact of a fraction sense intervention in authentic school environments: An initial investigation

Development and Validation of the Computational Thinking Test for Elementary School Students (CTT-ES): Correlate CT Competency With CT Disposition

The competent Computational Thinking test (cCTt): a valid, reliable and gender-fair test for longitudinal CT studies in grades 3-6

Developing the Critical Thinking Skill Test for High School Students: A Validity and Reliability Study

Building integrated number sense in adults and children: Comparing fractions-only training with cross-notation number line training

The competent Computational Thinking Test: Development and Validation of an Unplugged Computational Thinking Test for Upper Primary School

Number sense across the lifespan as revealed by a massive Internet-based sample