Abstract:Establishing the invariance property of an instrument (e.g., a questionnaire or test) is a key step for establishing its measurement validity. Measurement invariance is typically assessed by differential item functioning (DIF) analysis, i.e., detecting DIF items whose response distribution depends not only on the latent trait measured by the instrument but also on the group membership. DIF analysis is confounded by the group difference in the latent trait distributions. Many DIF analyses require knowing several anchor items that are DIF-free in order to draw inferences on whether each of the rest is a DIF item, where the anchor items are used to identify the latent trait distributions. When no prior information on anchor items is available, or some anchor items are misspecified, item purification methods and regularized estimation methods can be used. The former iteratively purifies the anchor set by a stepwise model selection procedure, and the latter selects the DIF-free items by a LASSO-type regularization approach. Unfortunately, unlike the methods based on a correctly specified anchor set, these methods are not guaranteed to provide valid statistical inference (e.g., confidence intervals and p-values). In this paper, we propose a new method for DIF analysis under a multiple indicators and multiple causes (MIMIC) model for DIF. This method adopts a minimal [Formula: see text] norm condition for identifying the latent trait distributions. Without requiring prior knowledge about an anchor set, it can accurately estimate the DIF effects of individual items and further draw valid statistical inferences for quantifying the uncertainty. Specifically, the inference results allow us to control the type-I error for DIF detection, which may not be possible with item purification and regularized estimation methods. We conduct simulation studies to evaluate the performance of the proposed method and compare it with the anchor-set-based likelihood ratio test approach and the LASSO approach. The proposed method is applied to analysing the three personality scales of the Eysenck personality questionnaire-revised (EPQ-R).

A Comparison of Using the Fixed Common-Precalibrated Parameter Method and the Matched Characteristic Curve Method for Linking Multiple-Test Items

Applying Unidimensional and Multidimensional Item Response Theory Models in Testlet-Based Reading Assessment

Nonlinear Sequential Designs for Logistic Item Response Theory Models with Applications to Computerized Adaptive Tests

Optimal Design for Item Calibration in Computerized Adaptive Testing: the 2PL Case

A two‐step item bank calibration strategy based on 1‐bit matrix completion for small‐scale computerized adaptive testing

Location-Matching Adaptive Testing for Polytomous Technology-Enhanced Items

A Method for Calibrating False-Match Rates in Record Linkage

A Comparative Review of Methods for Comparing Means Using Partially Paired Data

Linking essay-writing tests using many-facet models and neural automated essay scoring

Efficiency of computerized adaptive testing with a cognitively designed item bank

Approach to Fitting Testlet for Computerized Adaptive Language Testing

Nonparametric CD‐CAT for multiple‐choice items: Item selection method and Q‐optimality

Methods for online calibration of Q-matrix and item parameters for polytomous responses in cognitive diagnostic computerized adaptive testing

Novel item selection strategies for cognitive diagnostic computerized adaptive testing: A heuristic search framework

DIF Statistical Inference Without Knowing Anchoring Items

A Monte Carlo Study of an Iterative Wald Test Procedure for DIF Analysis

A-Stratified Multistage Computerized Adaptive Testing

Detecting uniform differential item functioning for continuous response computerized adaptive testing

Using a Linear Regression Method to Detect Outliers in IRT Common Item Equating

Assessing Item Fit Using Expected Score Curve Under Restricted Recalibration

Using Bayesian item response theory for multicohort repeated measure design to estimate individual latent change scores.