Abstract:The detection of differential item functioning（DIF） is an essential step for increasing the validity of a test among groups. A common feature of the conventional DIF approaches is that different groups of examinees are placed on the same metric based on a matching variable. However,contaminated matching variable would make the DIF detection biased. Some investigators developed the odds ratios（OR） method, which does not require matching variables. The OR method is easy to understand and simple for practitioners. However, all previous studies about the OR method are simulation studies, and the application of OR method in the DIF detecting of the academic achievement test needs further investigation. Previous studies indicated that the IRT-based approaches performed well in the DIF detecting of the academic achievement test. The Wald test and likelihood ratio test（LRT） are widely used in DIF detection as IRT-based approaches. It is helpful to compare the performance and the operating procedure of OR method with the Wald test and the LRT method.The current study aimed to introduce the operating procedure of the OR methods in the DIF detecting of the academic achievement test, and demonstrated that the OR method was a better method in DIF detecting by comparing the performance and the operating procedure among the OR method, the Wald test, and the LRT method. An empirical study was conducted, and the data was selected from an English test. Valid data from 3241senior high school students, including 1427 males（44.03%） were analyzed. The DIF detection was conducted on 35 dichotomous items from the English examination. The difficulty of the 35 dichotomous items were acceptable（from.20 to.80）. Besides, the Cronbach’s alphas of the 35 items were.86. The DIF detection results of the OR method, the Wald test, and the LRT method on English test would be testified and compared.The empirical study found that 16 items were detected as DIF items by the OR method, including both 8 items favoring females and males respectively. 14 items were detected as DIF items by the Wald χ2 test, including 10 items favoring females and 4 items favoring males. In addition,there were 14 items detected as DIF items by the LRT method, including 8 items favoring females and 6 items favoring males. The DIF detection results of the OR method and the LRT method were consistent for 31 items, and inconsistent for 4 items. The DIF detection results of the Wald χ2 test and the LRT method were consistent for 19 items, and inconsistent for 16 items.Previous studies have provided evidence for the application of the LRT method in the DIF detecting of the academic achievement test. This study further indicated that performance of the OR method was similar to the LRT method, but different to the Wald χ2 test. Thus, the present study also provided evidence for the application of OR method in the DIF detection of the academic achievement test, which was of great empirical value.Besides, concerning the operating procedure, the OR method is easy and simple for practitioners, and the computation task in the OR method is minimized. It is obvious that the OR method is more efficient. Generally speaking, the OR method is practicable and efficient in DIF detection.

MIMIC approach to assessing differential item functioning with control of extreme response style

DIF Statistical Inference Without Knowing Anchoring Items

Statistical Detection and Estimation of Differential Item Functioning in Computerized Adaptive Testing

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

A Comparison of Differential Item Functioning Detection Methods in Cognitive Diagnostic Models

Testing Differential Item Functioning Without Predefined Anchor Items Using Robust Regression

Mitigating Omitted Variable Bias in Exploratory Differential Item Functioning Assessment: A Propensity Score Adjustment Approach

Detecting uniform differential item functioning for continuous response computerized adaptive testing

Detecting DIF in Multidimensional Forced Choice Measures Using the Thurstonian Item Response Theory Model

Using a Generalized Logistic Regression Method to Detect Differential Item Functioning with Multiple Groups in Cognitive Diagnostic Tests

Enhancing Precision in Predicting Magnitude of Differential Item Functioning: An M-DIF Pretrained Model Approach

Exploring the Evidence to Interpret Differential Item Functioning via Response Process Data

Comparing multiple statistical software for multiple-indicator, multiple-cause modeling: an application of gender disparity in adult cognitive functioning using MIDUS II dataset

A Bayesian Moderated Nonlinear Factor Analysis Approach for DIF Detection under Violation of the Equal Variance Assumption

Differential Item Functioning via Robust Scaling

Detecting Differential Item Functioning Using Response Time

An Application of the Odds Ratios Method in Differential Item Functioning:An Illustration with an English Test

Using Interpretable Machine Learning for Differential Item Functioning Detection in Psychometric Tests

Gender-Based Differential Item Function for the Positive and Negative Semantic Dimensions of the Relationship Satisfaction Scale with Item Response Theory

Effect of Differential Item Functioning on Computer Adaptive Testing Under Different Conditions

A Monte Carlo Study of an Iterative Wald Test Procedure for DIF Analysis