Abstract:Establishing the invariance property of an instrument (e.g., a questionnaire or test) is a key step for establishing its measurement validity. Measurement invariance is typically assessed by differential item functioning (DIF) analysis, i.e., detecting DIF items whose response distribution depends not only on the latent trait measured by the instrument but also on the group membership. DIF analysis is confounded by the group difference in the latent trait distributions. Many DIF analyses require knowing several anchor items that are DIF-free in order to draw inferences on whether each of the rest is a DIF item, where the anchor items are used to identify the latent trait distributions. When no prior information on anchor items is available, or some anchor items are misspecified, item purification methods and regularized estimation methods can be used. The former iteratively purifies the anchor set by a stepwise model selection procedure, and the latter selects the DIF-free items by a LASSO-type regularization approach. Unfortunately, unlike the methods based on a correctly specified anchor set, these methods are not guaranteed to provide valid statistical inference (e.g., confidence intervals and p-values). In this paper, we propose a new method for DIF analysis under a multiple indicators and multiple causes (MIMIC) model for DIF. This method adopts a minimal [Formula: see text] norm condition for identifying the latent trait distributions. Without requiring prior knowledge about an anchor set, it can accurately estimate the DIF effects of individual items and further draw valid statistical inferences for quantifying the uncertainty. Specifically, the inference results allow us to control the type-I error for DIF detection, which may not be possible with item purification and regularized estimation methods. We conduct simulation studies to evaluate the performance of the proposed method and compare it with the anchor-set-based likelihood ratio test approach and the LASSO approach. The proposed method is applied to analysing the three personality scales of the Eysenck personality questionnaire-revised (EPQ-R).

Alchemy and beyond: Indexing the Defining Issues Test.

Moral rationality and intuition: An exploration of relationships between the Defining Issues Test and the Moral Foundations Questionnaire

Validity study using factor analyses on the Defining Issues Test-2 in undergraduate populations

Stages of moral judgment development: Applying item response theory to Defining Issues Test data

The Defining Issues Test and the Four Component Model: Contributions to professional education

Modified Cognitive Diagnostic Index and Modified Attribute-Level Discrimination Index for Test Construction

Measuring moral reasoning using moral dilemmas: evaluating reliability, validity, and differential item functioning of the behavioural defining issues test (bDIT)

Index Construction with Formative Indicators: An Alternative to Scale Development

How not to evaluate a psychological measure: Rebuttal to criticism of the Defining Issues Test of moral judgment development by Curzer and colleagues

A Nonparametric Composite Group DIF Index for Focal Groups Stemming from Multicategorical Variables

Improving the Assessment of Differential Item Functioning in Large-Scale Programs With Dual-Scale Purification of Rasch Models: The PISA Example

Insights From the Defining Issues Test on Moral Reasoning Competencies Development in Community Pharmacists

BIM-181: Revising the Public Domain "Basic Interest Markers" Using Item Response Theory

A novel alternative to analyzing multiple choice questions via discrimination index

An Examination of WAIS-IV Digit Span Performance Inconsistency as a Novel Embedded Performance Validity Test Among Adults Clinically Referred for Attention-Deficit/Hyperactivity Disorder

Contemporary Test Validity in Theory and Practice: A Primer for Discipline-Based Education Researchers

Moral Judgement Development in Higher Education: Insights from the Defining Issues Test

DIF Statistical Inference Without Knowing Anchoring Items

Composite indices, alternative weights, and comparison robustness

The Positive Discipline in Everyday Parenting Questionnaire: Psychometric Characteristics of a Revised Version

Challenges in Process Dissociation Measures for Moral Cognition