Abstract:Reading subskills are generally regarded as continuous variables, while most models used in the previous reading diagnoses have the hypothesis that the latent variables are dichotomous. Considering that the multidimensional item response theory (MIRT) model has continuous latent variables and can be used for diagnostic purposes, this study compared the performances of MIRT with two representatives of traditionally widely used models in reading diagnoses [reduced reparametrized unified model (R-RUM) and generalized deterministic, noisy, and gate (G-DINA)]. The comparison was carried out with both empirical and simulated data. First, model-data fit indices were used to evaluate whether MIRT was more appropriate than R-RUM and G-DINA with real data. Then, with the simulated data, relations between the estimated scores from MIRT, R-RUM, and G-DINA and the true scores were compared to examine whether the true abilities were well-represented, correct classification rates under different research conditions for MIRT, R-RUM, and G-DINA were calculated to examine the person parameter recovery, and the frequency distributions of subskill mastery probability were also compared to show the deviation of the estimated subskill mastery probabilities from the true values in the general value distribution. The MIRT obtained better model-data fit, gained estimated scores being a more reasonable representation for the true abilities, had an advantage on correct classification rates, and showed less deviation from the true values in frequency distributions of subskill mastery probabilities, which means it can produce more accurate diagnostic information about the reading abilities of the test-takers. Considering that more accurate diagnostic information has greater guiding value for the remedial teaching and learning, and in reading diagnoses, the score interpretation will be more reasonable with the MIRT model, this study recommended MIRT as a new methodology for future reading diagnostic analyses.

A Cognitive Diagnostic Assessment Study of the Listening Test of the Singapore–Cambridge General Certificate of Education O-Level: Application of DINA, DINO, G-DINA, HO-DINA, and RRUM

Diagnosing listening and reading skills in the Chinese EFL context: Performance stability and variability across modalities and performance levels

Research on the Cognitive Diagnosis of Chinese Listening Comprehension Ability Based on the G-DINA Model

Validating a Reading Assessment Within the Cognitive Diagnostic Assessment Framework: Q-Matrix Construction and Model Comparisons for Different Primary Grades

Application of a Cognitive Diagnostic Model to a High-Stakes Reading Comprehension Test

Cognitive Diagnostic Assessment of IELTS Listening: Providing Feedback from its Internal Structure

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

Cognitive Diagnostic Research on Chinese Students’ English Listening Skills and Implications on Skill Training

An Optimal Choice of Cognitive Diagnostic Model for Second Language Listening Comprehension Test

Cognitive diagnostic model of best choice: a study of reading comprehension

The selection of cognitive diagnostic models for a reading comprehension test

Cognitive Diagnostic Assessment of Listening Comprehension in College English Placement Test

Retrofitting Non-Cognitive-Diagnostic Reading Assessment under the Generalized Dina Model Framework

In Search of Optimal Cognitive Diagnostic Model(s) for ESL Grammar Test Data

Investigating the Relationships Between Listening Skills and Genre Competence Through Cognitive Diagnosis Approach

Exploring Reading Comprehension Skill Relationships Through the G-DINA Model

Model Selection for Cogitative Diagnostic Analysis of the Reading Comprehension Test

Towards Personalized English Learning Diagnosis: Cognitive Diagnostic Modelling for EFL Listening

Diagnosing Writing Ability Using China’s Standards of English Language Ability: Application of Cognitive Diagnosis Models

Developing individualized feedback for listening assessment: Combining standard setting and cognitive diagnostic assessment approaches

Cognitive Diagnostic Assessment of EFL Learners' Listening Barriers Through Incorrect Responses.