Abstract:Multivariate Item Response Theory (MIRT) is sought-after widely by applied researchers looking for interpretable (sparse) explanations underlying response patterns in questionnaire data. There is, however, an unmet demand for such sparsity discovery tools in practice. Our paper develops a Bayesian platform for binary and ordinal item MIRT which requires minimal tuning and scales well on relatively large datasets due to its parallelizable features. Bayesian methodology for MIRT models has traditionally relied on MCMC simulation, which cannot only be slow in practice, but also often renders exact sparsity recovery impossible without additional thresholding. In this work, we develop a scalable Bayesian EM algorithm to estimate sparse factor loadings from binary and ordinal item responses. We address the seemingly insurmountable problem of unknown latent factor dimensionality with tools from Bayesian nonparametrics which enable estimating the number of factors. Rotations to sparsity through parameter expansion further enhance convergence and interpretability without identifiability constraints. In our simulation study, we show that our method reliably recovers both the factor dimensionality as well as the latent structure on high-dimensional synthetic data even for small samples. We demonstrate the practical usefulness of our approach on two datasets: an educational item response dataset and a quality-of-life measurement dataset. Both demonstrations show that our tool yields interpretable estimates, facilitating interesting discoveries that might otherwise go unnoticed under a pure confirmatory factor analysis setting. We provide an easy-to-use software which is a useful new addition to the MIRT toolkit and which will hopefully serve as the go-to method for practitioners.

MultiLCIRT: An R package for multidimensional latent class item response models

multilevLCA: An R Package for Single-Level and Multilevel Latent Class Analysis with Covariates

Sparse Bayesian Multidimensional Item Response Theory

A multilevel finite mixture item response model to cluster examinees and schools

Bayesian Item Response Modeling in R with brms and Stan

A Multidimensional Latent Class Rasch Model for the Assessment of the Health-Related Quality of Life

An introduction to mixture item response theory models

Multidimensional Item Response Theory in the Style of Collaborative Filtering

A Bayesian Nonparametric IRT Model

LMest: an R package for latent Markov models for categorical longitudinal data

A Restricted Latent Class Model with Polytomous Attributes and Respondent-Level Covariates

Modeling repeated self-reported outcome data: A continuous-time longitudinal Item Response Theory model

A Nonparametric Bayesian Item Response Modeling Approach for Clustering Items and Individuals Simultaneously

KernSmoothIRT: An R Package for Kernel Smoothing in Item Response Theory

Fitting item response unfolding models to Likert-scale data using mirt in R

Robust Measurement Via A Fused Latent and Graphical Item Response Theory Model

A nonparametric Bayesian item response modelling approach for clustering items and individuals simultaneously

Simple Structure Detection Through Bayesian Exploratory Multidimensional IRT Models

Flexible Bayesian modelling in dichotomous item response theory using mixtures of skewed item curves

2PL Model: Compare Generalized Linear Mixed Model with Latent Variable Model based IRT framework

Alternative Approaches to Addressing Non-Normal Distributions in the Application of IRT Models to Personality Measures