Abstract:Establishing the invariance property of an instrument (e.g., a questionnaire or test) is a key step for establishing its measurement validity. Measurement invariance is typically assessed by differential item functioning (DIF) analysis, i.e., detecting DIF items whose response distribution depends not only on the latent trait measured by the instrument but also on the group membership. DIF analysis is confounded by the group difference in the latent trait distributions. Many DIF analyses require knowing several anchor items that are DIF-free in order to draw inferences on whether each of the rest is a DIF item, where the anchor items are used to identify the latent trait distributions. When no prior information on anchor items is available, or some anchor items are misspecified, item purification methods and regularized estimation methods can be used. The former iteratively purifies the anchor set by a stepwise model selection procedure, and the latter selects the DIF-free items by a LASSO-type regularization approach. Unfortunately, unlike the methods based on a correctly specified anchor set, these methods are not guaranteed to provide valid statistical inference (e.g., confidence intervals and p-values). In this paper, we propose a new method for DIF analysis under a multiple indicators and multiple causes (MIMIC) model for DIF. This method adopts a minimal [Formula: see text] norm condition for identifying the latent trait distributions. Without requiring prior knowledge about an anchor set, it can accurately estimate the DIF effects of individual items and further draw valid statistical inferences for quantifying the uncertainty. Specifically, the inference results allow us to control the type-I error for DIF detection, which may not be possible with item purification and regularized estimation methods. We conduct simulation studies to evaluate the performance of the proposed method and compare it with the anchor-set-based likelihood ratio test approach and the LASSO approach. The proposed method is applied to analysing the three personality scales of the Eysenck personality questionnaire-revised (EPQ-R).

It Matters: Reference Indicator Selection in Measurement Invariance Tests

The dire disregard of measurement invariance testing in psychological science.

Measurement Invariance Testing Works

Measurement Invariance in Intellectual and Developmental Disability Research

Tests for a Multiple-Sample Problem in High Dimensions

Measuring up: the significance of measurement invariance in cardiovascular research

MIsgivings about measurement invariance

DIF Statistical Inference Without Knowing Anchoring Items

Alternatives to Weighted Item Fit Statistics for Establishing Measurement Invariance in Many Groups

Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance

Comparing Attitudes Across Groups: An IRT-Based Item-Fit Statistic for the Analysis of Measurement Invariance

A Comparison of FIML- versus Multiple-imputation-based methods to test measurement invariance with incomplete ordinal variables

Measurement invariance of the Satisfaction with Life Scale: reviewing three decades of research

A Unified Information Criterion For Evaluating Probe And Test Selection

Invariance: What Does Measurement Invariance Allow Us to Claim?

Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance

Testing measurement invariance across groups: applications in cross-cultural research.

The I2 Test for Selection Bias Risk Assessment in Single Trials: Recommended Simulated Comparator Trial (SCT) Settings

Studying Factorial Invariance With Nominal Items: A Note on a Latent Variable Modeling Procedure

The Impact of Insufficient Effort Responding Detection Methods on Substantive Responses: Results from an Experiment Testing Parameter Invariance