Abstract:Ensuring fairness in instruments like survey questionnaires or educational tests is crucial. One way to address this is by a Differential Item Functioning (DIF) analysis, which examines if different subgroups respond differently to a particular item, controlling for their overall latent construct level. DIF analysis is typically conducted to assess measurement invariance at the item level. Traditional DIF analysis methods require knowing the comparison groups (reference and focal groups) and anchor items (a subset of DIF-free items). Such prior knowledge may not always be available, and psychometric methods have been proposed for DIF analysis when one piece of information is unknown. More specifically, when the comparison groups are unknown while anchor items are known, latent DIF analysis methods have been proposed that estimate the unknown groups by latent classes. When anchor items are unknown while comparison groups are known, methods have also been proposed, typically under a sparsity assumption – the number of DIF items is not too large. However, DIF analysis when both pieces of information are unknown has not received much attention. This paper proposes a general statistical framework under this setting. In the proposed framework, we model the unknown groups by latent classes and introduce item-specific DIF parameters to capture the DIF effects. Assuming the number of DIF items is relatively small, an -regularised estimator is proposed to simultaneously identify the latent classes and the DIF items. A computationally efficient Expectation-Maximisation (EM) algorithm is developed to solve the non-smooth optimisation problem for the regularised estimator. The performance of the proposed method is evaluated by simulation studies and an application to item response data from a real-world educational test.

Fairness and Comparability in Achievement Motivation Items: A Differential Item Functioning Analysis

Test Fairness: Examining Differential Functioning of the Reading Comprehension Section of the GSEEE in China

Exploring the Evidence to Interpret Differential Item Functioning via Response Process Data

Factorial Invariance of the Questionnaire about Interpersonal Difficulties for Adolescents Across Spanish and Chinese Adolescent Samples

A Psychometric Framework for Evaluating Fairness in Algorithmic Decision Making: Differential Algorithmic Functioning

Using Interpretable Machine Learning for Differential Item Functioning Detection in Psychometric Tests

Investigating Differential Item Functioning Across Interaction Variables in Listening Comprehension Assessment

Examining Differential Item Functioning In A Computer-Based English Proficiency Test

Examination of Gender-Related Differential Item Functioning Through Poly-BW Indices

DIF Analysis with Unknown Groups and Anchor Items

Differential Item Functioning of the Youth Psychopathic Traits Inventory Across Race/Ethnicity and Gender Among a Sample of Justice-Involved Youth: An Item Response Theory Analysis

The Effect of a National Education Policy on Language Test Performance: a Fairness Perspective

Detecting Differential Item Functioning Using Response Time

Improving the Assessment of Differential Item Functioning in Large-Scale Programs With Dual-Scale Purification of Rasch Models: The PISA Example

Unveiling disparities: examining differential item functioning's impact on racial health equity among white and black populations

Comparing Attitudes Across Groups: An IRT-Based Item-Fit Statistic for the Analysis of Measurement Invariance

Differential Item Functioning Analysis of the Science and Mathematics Items in the University Entrance Examinations in Turkey

Universal screening for social-emotional and behavioral risk: Differential item functioning on the SAEBRS

Gender-Based Differential Item Function for the Positive and Negative Semantic Dimensions of the Relationship Satisfaction Scale with Item Response Theory

Measurement equivalence in ADL and IADL difficulty across international surveys of aging: findings from the HRS, SHARE, and ELSA

DIF Detection for Multiple Groups: Comparing Three‐Level GLMMs and Multiple‐Group IRT Models