Abstract:Educational and Psychological Measurement, Ahead of Print. Rapid-guessing behavior in data can compromise our ability to estimate item and person parameters accurately. Consequently, it is crucial to model data with rapid-guessing patterns in a way that can produce unbiased ability estimates. This study proposes and evaluates three alternative modeling approaches that follow the logic of the effort-moderated item response theory model (EM-IRT) to analyze response data with rapid-guessing responses. One is the two-step EM-IRT model, which utilizes the item parameters estimated by respondents without rapid-guessing behavior and was initially proposed by Rios and Soland without further investigation. The other two models are effort-moderated multidimensional models (EM-MIRT), which we introduce in this study and vary as both between-item and within-item structures. The advantage of the EM-MIRT model is to account for the underlying relationship between rapid-guessing propensity and ability. The three models were compared with the traditional EM-IRT model regarding the accuracy of parameter recovery in various simulated conditions. Results demonstrated that the two-step EM-IRT and between-item EM-MIRT model consistently outperformed the traditional EM-IRT model under various conditions, with the two-step EM-IRT estimation generally delivering the best performance, especially for ability and item difficulty parameters estimation. In addition, different rapid-guessing patterns (i.e., difficulty-based, changing state, and decreasing effort) did not affect the performance of the two-step EM-IRT model. Overall, the findings suggest that the EM-IRT model with the two-step parameter estimation method can be applied in practice for estimating ability in the presence of rapid-guessing responses due to its accuracy and efficiency. The between-item EM-MIRT model can be used as an alternative model when there is no significant mean difference in the ability estimates between examinees who exhibit rapid-guessing behavior and those who do not.

Variational Estimation for Multidimensional Generalized Partial Credit Model

A Note on Improving Variational Estimation for Multidimensional Item Response Theory

Maximum Marginal Likelihood Estimation of a Monotonic Polynomial Generalized Partial Credit Model with Applications to Multiple Group Analysis

Parameter Recovery with Marginal Maximum Likelihood and Markov Chain Monte Carlo Estimation for the Generalized Partial Credit Model

Sparse Bayesian Multidimensional Item Response Theory

Regularized Variational Estimation for Exploratory Item Factor Analysis

Large Dimensional Time-Varying GMM Estimation: A New Approach

A Nonparametric GMM Series Approach to Solving Multi-equation Asset Pricing Models with Recursive Preferences

Bayesian estimation of multidimensional polytomous item response theory models with Q-matrices using Stan

A Note on Standard Errors for Multidimensional Two-Parameter Logistic Models Using Gaussian Variational Estimation

Variational Item Response Theory: Fast, Accurate, and Expressive

A GENERALIZED PARTIAL CREDIT MODEL: APPLICATION OF AN EM ALGORITHM

Enhancing Effort-Moderated Item Response Theory Models by Evaluating a Two-Step Estimation Method and Multidimensional Variations on the Model

Parameter recovery of skew multidimensional multiple-group item response models (MGM-MIRT): a comparison of MCMC algorithms and assessment of effects of interest

Modeling Item Response Theory with Stochastic Variational Inference

A Fused Latent and Graphical Model for Multivariate Binary Data

Latent Variable Selection for Multidimensional Item Response Theory Models Via L-1 Regularization

Development of Integrated Choice and Latent Variable (ICLV) Models Using Matrix-Based Analytic Approximation and Automatic Differentiation Methods on TensorFlow Platform

REGULARIZED GMM FOR TIME‐VARYING MODELS WITH APPLICATIONS TO ASSET PRICING

Multidimensional Item Response Theory in the Style of Collaborative Filtering

A Time-Varying Dynamic Partial Credit Model to Analyze Polytomous and Multivariate Time Series Data