Abstract:In the era of data explosion, statisticians have been developing interpretable and computationally efficient statistical methods to measure latent factors (e.g., skills, abilities, and personalities) using large-scale assessment data. In addition to understanding the latent information, the covariate effect on responses controlling for latent factors is also of great scientific interest and has wide applications, such as evaluating the fairness of educational testing, where the covariate effect reflects whether a test question is biased toward certain individual characteristics (e.g., gender and race) taking into account their latent abilities. However, the large sample size, substantial covariate dimension, and great test length pose challenges to developing efficient methods and drawing valid inferences. Moreover, to accommodate the commonly encountered discrete types of responses, nonlinear latent factor models are often assumed, bringing further complexity to the problem. To address these challenges, we consider a covariate-adjusted generalized factor model and develop novel and interpretable conditions to address the identifiability issue. Based on the identifiability conditions, we propose a joint maximum likelihood estimation method and establish estimation consistency and asymptotic normality results for the covariate effects under a practical yet challenging asymptotic regime. Furthermore, we derive estimation and inference results for latent factors and the factor loadings. We illustrate the finite sample performance of the proposed method through extensive numerical studies and an application to an educational assessment dataset obtained from the Programme for International Student Assessment (PISA).

Modeling Individualized Coefficient Alpha to Measure Quality of Test Score Data.

Modeling Coefficient Alpha for Measurement of Individualized Test Score Internal Consistency

Coh-Metrix Model-Based Automatic Assessment of Interpreting Quality

Understanding Alpha and Beta and Sources of Common Variance: Theoretical Underpinnings and a Practical Example

Robust Coefficients Alpha And Omega And Confidence Intervals With Outlying Observations And Missing Data: Methods And Software

Image Quality Score Distribution Prediction Via Alpha Stable Model

Alpha, Omega, and H Internal Consistency Reliability Estimates: Reviewing These Options and When to Use Them

Applying Unidimensional and Multidimensional Item Response Theory Models in Testlet-Based Reading Assessment

Testing Alpha in High Dimensional Linear Factor Pricing Models with Dependent Observations

Resampling-based inference methods for comparing two coefficient alpha

From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation

The Effect of Non-normal Distribution Measurement Data on Cronbach's Alpha Reliability Coefficient

Alpha Coefficient and Congeneric Test

Subgroup Analysis of Linear Models with Measurement Error

Choosing Between Cronbach's Coefficient Alpha, McDonald's Coefficient Omega, and Coefficient H: Confidence Intervals and the Advantages and Drawbacks of Interpretive Guidelines

Cronbach’s Coefficient Alpha

Robust estimation of Cronbach's alpha

A Two-Stage Approach to Differentiating Normal and Aberrant Behavior in Computer Based Testing

Parameterized Image Quality Score Distribution Prediction

Beyond alpha and omega: The accuracy of single-test reliability estimators in unidimensional continuous data

Statistical Inference for Covariate-Adjusted and Interpretable Generalized Factor Model with Application to Testing Fairness