Abstract:Establishing the invariance property of an instrument (e.g., a questionnaire or test) is a key step for establishing its measurement validity. Measurement invariance is typically assessed by differential item functioning (DIF) analysis, i.e., detecting DIF items whose response distribution depends not only on the latent trait measured by the instrument but also on the group membership. DIF analysis is confounded by the group difference in the latent trait distributions. Many DIF analyses require knowing several anchor items that are DIF-free in order to draw inferences on whether each of the rest is a DIF item, where the anchor items are used to identify the latent trait distributions. When no prior information on anchor items is available, or some anchor items are misspecified, item purification methods and regularized estimation methods can be used. The former iteratively purifies the anchor set by a stepwise model selection procedure, and the latter selects the DIF-free items by a LASSO-type regularization approach. Unfortunately, unlike the methods based on a correctly specified anchor set, these methods are not guaranteed to provide valid statistical inference (e.g., confidence intervals and p-values). In this paper, we propose a new method for DIF analysis under a multiple indicators and multiple causes (MIMIC) model for DIF. This method adopts a minimal [Formula: see text] norm condition for identifying the latent trait distributions. Without requiring prior knowledge about an anchor set, it can accurately estimate the DIF effects of individual items and further draw valid statistical inferences for quantifying the uncertainty. Specifically, the inference results allow us to control the type-I error for DIF detection, which may not be possible with item purification and regularized estimation methods. We conduct simulation studies to evaluate the performance of the proposed method and compare it with the anchor-set-based likelihood ratio test approach and the LASSO approach. The proposed method is applied to analysing the three personality scales of the Eysenck personality questionnaire-revised (EPQ-R).

Alternatives to Weighted Item Fit Statistics for Establishing Measurement Invariance in Many Groups

Comparing Attitudes Across Groups: An IRT-Based Item-Fit Statistic for the Analysis of Measurement Invariance

Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance

Bayesian penalty methods for evaluating measurement invariance in moderated nonlinear factor analysis.

The dire disregard of measurement invariance testing in psychological science.

It Matters: Reference Indicator Selection in Measurement Invariance Tests

New Robust Scale Transformation Methods in the Presence of Outlying Common Items.

Measurement Invariance in Intellectual and Developmental Disability Research

Asymptotically Normally Distributed Person Fit Indices for Detecting Spuriously High Scores on Difficult Items

Measuring up: the significance of measurement invariance in cardiovascular research

A Comparison of FIML- versus Multiple-imputation-based methods to test measurement invariance with incomplete ordinal variables

DIF Statistical Inference Without Knowing Anchoring Items

A study of alternative approaches to non-normal latent trait distributions in item response theory models used for health outcome measurement

Standard Errors for National Trends in International Large-Scale Assessments in the Case of Cross-National Differential Item Functioning

Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance

Item-Weighted Likelihood Method for Measuring Growth in Longitudinal Study With Tests Composed of Both Dichotomous and Polytomous Items

Measurement equivalence in ADL and IADL difficulty across international surveys of aging: findings from the HRS, SHARE, and ELSA

Using Regularization to Identify Measurement Bias Across Multiple Background Characteristics: A Penalized Expectation–Maximization Algorithm

MIsgivings about measurement invariance

Visualizemi: Visualization, Effect Size, and Replication of Measurement Invariance for Registered Reports

Invariance: What Does Measurement Invariance Allow Us to Claim?