Abstract:Reading subskills are generally regarded as continuous variables, while most models used in the previous reading diagnoses have the hypothesis that the latent variables are dichotomous. Considering that the multidimensional item response theory (MIRT) model has continuous latent variables and can be used for diagnostic purposes, this study compared the performances of MIRT with two representatives of traditionally widely used models in reading diagnoses [reduced reparametrized unified model (R-RUM) and generalized deterministic, noisy, and gate (G-DINA)]. The comparison was carried out with both empirical and simulated data. First, model-data fit indices were used to evaluate whether MIRT was more appropriate than R-RUM and G-DINA with real data. Then, with the simulated data, relations between the estimated scores from MIRT, R-RUM, and G-DINA and the true scores were compared to examine whether the true abilities were well-represented, correct classification rates under different research conditions for MIRT, R-RUM, and G-DINA were calculated to examine the person parameter recovery, and the frequency distributions of subskill mastery probability were also compared to show the deviation of the estimated subskill mastery probabilities from the true values in the general value distribution. The MIRT obtained better model-data fit, gained estimated scores being a more reasonable representation for the true abilities, had an advantage on correct classification rates, and showed less deviation from the true values in frequency distributions of subskill mastery probabilities, which means it can produce more accurate diagnostic information about the reading abilities of the test-takers. Considering that more accurate diagnostic information has greater guiding value for the remedial teaching and learning, and in reading diagnoses, the score interpretation will be more reasonable with the MIRT model, this study recommended MIRT as a new methodology for future reading diagnostic analyses.

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

Validating a Reading Assessment Within the Cognitive Diagnostic Assessment Framework: Q-Matrix Construction and Model Comparisons for Different Primary Grades

An Optimal Choice of Cognitive Diagnostic Model for Second Language Listening Comprehension Test

Applying Unidimensional and Multidimensional Item Response Theory Models in Testlet-Based Reading Assessment

Diagnosing listening and reading skills in the Chinese EFL context: Performance stability and variability across modalities and performance levels

Model Selection for Cogitative Diagnostic Analysis of the Reading Comprehension Test

Diagnosing Writing Ability Using China’s Standards of English Language Ability: Application of Cognitive Diagnosis Models

Research on the Cognitive Diagnosis of Chinese Listening Comprehension Ability Based on the G-DINA Model

Developing individualized feedback for listening assessment: Combining standard setting and cognitive diagnostic assessment approaches

The selection of cognitive diagnostic models for a reading comprehension test

Towards Personalized English Learning Diagnosis: Cognitive Diagnostic Modelling for EFL Listening

Cognitive Diagnostic Assessment of IELTS Listening: Providing Feedback from its Internal Structure

Evaluating a National Traditional Chinese Medicine Examination via Cognitive Diagnostic Approaches

Retrofitting Non-Cognitive-Diagnostic Reading Assessment under the Generalized Dina Model Framework

Modeling mediation in the dynamic assessment of listening ability from the cognitive diagnostic perspective

A Cognitive Diagnostic Assessment Study of the Listening Test of the Singapore–Cambridge General Certificate of Education O-Level: Application of DINA, DINO, G-DINA, HO-DINA, and RRUM

A Comparison of Differential Item Functioning Detection Methods in Cognitive Diagnostic Models

Exploration of Item Selection in Dual-Purpose Cognitive Diagnostic Computerized Adaptive Testing: Based on the RRUM.

Application of a Cognitive Diagnostic Model to a High-Stakes Reading Comprehension Test

Cognitive Diagnostic Research on Chinese Students’ English Listening Skills and Implications on Skill Training

Estimating Classification Accuracy and Consistency Indices for Multidimensional Latent Ability