Abstract:Computational thinking (CT) has permeated primary and early childhood education in recent years. Despite the extensive effort in CT learning initiatives, few age-appropriate assessment tools targeting young children have been developed. In this study, we proposed Computational Thinking Test for Lower Primary (CTtLP), which was designed for lower primary school students (aged 6–10). Based on the evidence-centred design approach, a set of constructed-response items that are independent of programming platforms was developed. To validate the test, content validation was first performed via expert review and cognitive interviews, and refinements were made based on the comments. Then, a large-scale field test was administered with a sample of 1st–3rd graders (N = 1225), and the data was used for psychometric analysis based on both classical test theory (CTT) and item response theory (IRT). The CTT results provided robust criterion validity, internal consistency, and test–retest reliability values. Regarding IRT results, a three-parameter logistic model was selected according to the item fit indices, based on which fair item parameters and test information reliability were generated. Overall, the test items and the whole scale showed proper fit, suggesting that CTtLP was a suitable test for the target group. Analyses of the test performance were then put forward. Results reported that students' performance improved with grade level, and no gender difference was detected. Based on the test responses, we also identified children's challenges in understanding CT constructs, indicating that students tended to have difficulty in understanding loop control and executing multiple directions. The study provides a rigorously validated diagnostic test for measuring CT acquisition in lower primary school students and demonstrates a replicable design and validation process for future assessment practices, and findings on the difficulties children faced in CT conceptual understanding could shed light on CT primary and early childhood education.

A Digital Game-Based Model for Assessing Computational Thinking Skills

Assessing Students' Computational Thinking In A Learning By Modeling Environment

Video games for assessing computational thinking: a systematic literature review

Assessing computational thinking: A systematic review of empirical studies

Towards the Development of a Game for Computational Thinking

Teaching and Learning Computational Thinking Through Game-Based Learning: A Systematic Review

Development and Validation of Computational Thinking Assessment of Chinese Elementary School Students

Collaborative Game-Based Environment and Assessment Tool for Learning Computational Thinking in Primary School: A Case Study

Analyzing-Evaluating-Creating: Assessing Computational Thinking and Problem Solving in Visual Programming Domains

Video Games: A Potential Vehicle for Teaching Computational Thinking

A Game-Based Learning Assessment Framework for Learning Ubiquitous Computational Thinking

Leveraging Evidence-Centered Design to Develop Assessments of Computational Thinking Practices

Game-Based Assessment of Students' Digital Literacy Using Evidence-Centered Game Design

The CTSkills App -- Measuring Problem Decomposition Skills of Students in Computational Thinking

Computational thinking with game design: An action research study with middle school students

Design and validation of learning trajectory-based assessments for computational thinking in upper elementary grades

Educational games promote the development of students’ computational thinking: a meta-analytic review

Development and validation of a computational thinking test for lower primary school students

The Computational Thinking Scale for Computer Literacy Education

Developing and Testing a Design-Based Learning Approach to Enhance Elementary Students’ Self-Perceived Computational Thinking

A Systematic Umbrella Review on Computational Thinking Assessment in Higher Education