Abstract:Monitoring the progress of student learning is an important part of teachers' data-based decision making. One such tool that can equip teachers with information about students' learning progress throughout the school year and thus facilitate monitoring and instructional decision making is learning progress assessments. In practical contexts and research, estimating learning progress has relied on approaches that seek to estimate progress either for each student separately or within overarching model frameworks, such as latent growth modeling. Two recently emerging lines of research for separately estimating student growth have examined robust estimation (to account for outliers) and Bayesian approaches (as opposed to commonly used frequentist methods). The aim of this work was to combine these approaches (i.e., robust Bayesian estimation) and extend these lines of research to the framework of linear latent growth models. In a sample of N = 4970 second-grade students who worked on the quop-L2 test battery (to assess reading comprehension) at eight measurement points, we compared three Bayesian linear latent growth models: (a) a Gaussian model, (b) a model based on Student's t-distribution (i.e., a robust model), and (c) an asymmetric Laplace model (i.e., Bayesian quantile regression and an alternative robust model). Based on leave-one-out cross-validation and posterior predictive model checking, we found that both robust models outperformed the Gaussian model, and both robust models performed comparably well. While the Student's t model performed statistically slightly better (yet not substantially so), the asymmetric Laplace model yielded somewhat more realistic posterior predictive samples and a higher degree of measurement precision (i.e., for those estimates that were either associated with the lowest or highest degree of measurement precision). The findings are discussed for the context of learning progress assessment.

Dynamic Models of Learning and Education Measurement

Dynamic measurement: A theoretical–psychometric paradigm for modern educational psychology

Bayesian analysis of dynamic item response models in educational testing

Measuring Learning Gains in Chemical Education: A Comparison of Two Methods

A comparison of Hake's g and Cohen's d for analyzing gains on concept inventories

Shaky Student Growth? A Comparison of Robust Bayesian Learning Progress Estimation Methods

Interpreting gains and losses in conceptual test using Item Response Theory

Individual gain and engagement with mathematical understanding

Conditioning on the pre-test versus gain score modeling: revisiting the controversy in a multilevel setting

The methodology of testing naive beliefs in the physics classroom

Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions

Discrete Dynamic Modeling of Learner Behavior Analysis in Physical Education Teaching

Detecting Preknowledge Cheating via Innovative Measures: A Mixture Hierarchical Model for Jointly Modeling Item Responses, Response Times, and Visual Fixation Counts

Modernizing use of regression models in physics education research: a review of hierarchical linear modeling

Applying Cognitive Diagnostic Models to Mechanics Concept Inventories

A Model to Predict and Analyze Students' Learning Preferences and their Cognitive Development through Educational Big Data

Measurement Models, Estimation, and the Study of Change

A Dynamic Model of Demand-Ability Fit Change in Proactive Socialization: A Latent Change Score Approach

Dynamic Testing of Instructional Needs: A Training-Only Graduated Prompts Approach

Problem-based Interactive Physics E-Module in Physics Learning Through Blended PBL to Enhance Students' Critical Thinking Skills

Enhancing Pre-service Physics Teachers' Higher-Order Thinking Skills Through STEM-PjBL Model