Abstract:In the era of data explosion, statisticians have been developing interpretable and computationally efficient statistical methods to measure latent factors (e.g., skills, abilities, and personalities) using large-scale assessment data. In addition to understanding the latent information, the covariate effect on responses controlling for latent factors is also of great scientific interest and has wide applications, such as evaluating the fairness of educational testing, where the covariate effect reflects whether a test question is biased toward certain individual characteristics (e.g., gender and race) taking into account their latent abilities. However, the large sample size, substantial covariate dimension, and great test length pose challenges to developing efficient methods and drawing valid inferences. Moreover, to accommodate the commonly encountered discrete types of responses, nonlinear latent factor models are often assumed, bringing further complexity to the problem. To address these challenges, we consider a covariate-adjusted generalized factor model and develop novel and interpretable conditions to address the identifiability issue. Based on the identifiability conditions, we propose a joint maximum likelihood estimation method and establish estimation consistency and asymptotic normality results for the covariate effects under a practical yet challenging asymptotic regime. Furthermore, we derive estimation and inference results for latent factors and the factor loadings. We illustrate the finite sample performance of the proposed method through extensive numerical studies and an application to an educational assessment dataset obtained from the Programme for International Student Assessment (PISA).

Inference for Large Dimensional Factor Models under General Missing Data Patterns

Large Dimensional Latent Factor Modeling with Missing Observations and Applications to Causal Inference

Inferential Theory for Factor Models of Large Dimensions

Simultaneous Inference For High-Dimensional Approximate Factor Model

State-Varying Factor Models of Large Dimensions

Optimal Estimation of Large-Dimensional Nonlinear Factor Models

On Factor Models with Random Missing: EM Estimation, Inference, and Cross Validation

Estimating Equations Inference with Missing Data

Statistical Inference for Large-dimensional Matrix Factor Model from Least Squares and Huber Loss Points of View

A unified framework of analyzing missing data and variable selection using regularized likelihood

Efficient Estimation of Approximate Factor Models via Regularized Maximum Likelihood

Efficient Inference on High-Dimensional Linear Models with Missing Outcomes

Missing Data Analysis with Sufficient Dimension Reduction

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Statistical Inference for Covariate-Adjusted and Interpretable Generalized Factor Model with Application to Testing Fairness

Inference in Sparsity-Induced Weak Factor Models

Quasi Maximum Likelihood Estimation and Inference of Large Approximate Dynamic Factor Models via the EM algorithm

An Efficient Multiple Imputation Approach for Estimating Equations with Response Missing at Random and High-Dimensional Covariates

Nonstandard Conditionally Specified Models for Nonignorable Missing Data.

Econometric Analysis of Large Factor Models

Statistical Inferences Using Large Estimated Covariances for Panel Data and Factor Models