Abstract:Multivariate Item Response Theory (MIRT) is sought-after widely by applied researchers looking for interpretable (sparse) explanations underlying response patterns in questionnaire data. There is, however, an unmet demand for such sparsity discovery tools in practice. Our paper develops a Bayesian platform for binary and ordinal item MIRT which requires minimal tuning and scales well on relatively large datasets due to its parallelizable features. Bayesian methodology for MIRT models has traditionally relied on MCMC simulation, which cannot only be slow in practice, but also often renders exact sparsity recovery impossible without additional thresholding. In this work, we develop a scalable Bayesian EM algorithm to estimate sparse factor loadings from binary and ordinal item responses. We address the seemingly insurmountable problem of unknown latent factor dimensionality with tools from Bayesian nonparametrics which enable estimating the number of factors. Rotations to sparsity through parameter expansion further enhance convergence and interpretability without identifiability constraints. In our simulation study, we show that our method reliably recovers both the factor dimensionality as well as the latent structure on high-dimensional synthetic data even for small samples. We demonstrate the practical usefulness of our approach on two datasets: an educational item response dataset and a quality-of-life measurement dataset. Both demonstrations show that our tool yields interpretable estimates, facilitating interesting discoveries that might otherwise go unnoticed under a pure confirmatory factor analysis setting. We provide an easy-to-use software which is a useful new addition to the MIRT toolkit and which will hopefully serve as the go-to method for practitioners.

Three- and four-parameter item response model in factor analysis framework

An Item Response Theory Model for Incorporating Response Times in Forced-Choice Measures

Semiparametric Factor Analysis for Item-Level Response Time Data

Robust Measurement Via A Fused Latent and Graphical Item Response Theory Model

Linear Factor Analytic Thurstonian Forced-Choice Models: Current Status and Issues

Item Response Theory -- A Statistical Framework for Educational and Psychological Measurement

Joint Maximum Likelihood Estimation for High-Dimensional Exploratory Item Factor Analysis

Sparse Bayesian Multidimensional Item Response Theory

Joint modeling of the two-alternative multidimensional forced-choice personality measurement and its response time by a Thurstonian D-diffusion item response model

Bayesian Item Response Modeling in R with brms and Stan

A Deep Learning Algorithm for High-Dimensional Exploratory Item Factor Analysis

Redefining Item Response Models for Small Samples

Model Fit and Item Factor Analysis: Overfactoring, Underfactoring, and a Program to Guide Interpretation

A Fused Latent and Graphical Model for Multivariate Binary Data

A Bayesian Random Block Item Response Theory Model for Forced-Choice Formats

Joint Maximum Likelihood Estimation for High-dimensional Exploratory Item Response Analysis

Deep Learning-Based Estimation and Goodness-of-Fit for Large-Scale Confirmatory Item Factor Analysis

Flexible Bayesian modelling in dichotomous item response theory using mixtures of skewed item curves

A solution for factorial validity testing of three-item scales: An example of tau-equivalent strict measurement invariance of three-item loneliness scale

A Bayesian Nonparametric IRT Model

Variational Item Response Theory: Fast, Accurate, and Expressive