Abstract:Reading subskills are generally regarded as continuous variables, while most models used in the previous reading diagnoses have the hypothesis that the latent variables are dichotomous. Considering that the multidimensional item response theory (MIRT) model has continuous latent variables and can be used for diagnostic purposes, this study compared the performances of MIRT with two representatives of traditionally widely used models in reading diagnoses [reduced reparametrized unified model (R-RUM) and generalized deterministic, noisy, and gate (G-DINA)]. The comparison was carried out with both empirical and simulated data. First, model-data fit indices were used to evaluate whether MIRT was more appropriate than R-RUM and G-DINA with real data. Then, with the simulated data, relations between the estimated scores from MIRT, R-RUM, and G-DINA and the true scores were compared to examine whether the true abilities were well-represented, correct classification rates under different research conditions for MIRT, R-RUM, and G-DINA were calculated to examine the person parameter recovery, and the frequency distributions of subskill mastery probability were also compared to show the deviation of the estimated subskill mastery probabilities from the true values in the general value distribution. The MIRT obtained better model-data fit, gained estimated scores being a more reasonable representation for the true abilities, had an advantage on correct classification rates, and showed less deviation from the true values in frequency distributions of subskill mastery probabilities, which means it can produce more accurate diagnostic information about the reading abilities of the test-takers. Considering that more accurate diagnostic information has greater guiding value for the remedial teaching and learning, and in reading diagnoses, the score interpretation will be more reasonable with the MIRT model, this study recommended MIRT as a new methodology for future reading diagnostic analyses.

Cognitive diagnostic model of best choice: a study of reading comprehension

The selection of cognitive diagnostic models for a reading comprehension test

Validating a Reading Assessment Within the Cognitive Diagnostic Assessment Framework: Q-Matrix Construction and Model Comparisons for Different Primary Grades

Application of a Cognitive Diagnostic Model to a High-Stakes Reading Comprehension Test

An Optimal Choice of Cognitive Diagnostic Model for Second Language Listening Comprehension Test

Model Selection for Cogitative Diagnostic Analysis of the Reading Comprehension Test

Retrofitting Non-Cognitive-Diagnostic Reading Assessment under the Generalized Dina Model Framework

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

A Cognitive Diagnostic Assessment Study of the Listening Test of the Singapore–Cambridge General Certificate of Education O-Level: Application of DINA, DINO, G-DINA, HO-DINA, and RRUM

Diagnosing listening and reading skills in the Chinese EFL context: Performance stability and variability across modalities and performance levels

In Search of Optimal Cognitive Diagnostic Model(s) for ESL Grammar Test Data

Diagnosing Writing Ability Using China’s Standards of English Language Ability: Application of Cognitive Diagnosis Models

Cognitive Diagnostic Assessment of IELTS Listening: Providing Feedback from its Internal Structure

Exploring Reading Comprehension Skill Relationships Through the G-DINA Model

Test Construction for Cognitive Diagnosis

Exploration of Item Selection in Dual-Purpose Cognitive Diagnostic Computerized Adaptive Testing: Based on the RRUM.

Applying Unidimensional and Multidimensional Item Response Theory Models in Testlet-Based Reading Assessment

Preference Cognitive Diagnosis for Predicting Examinee Performance

Examining the L2 reading comprehension ability of adult ELLs: Developing a diagnostic test within the cognitive diagnostic assessment framework

Probing the relative importance of different attributes in L2 reading and listening comprehension items: An application of cognitive diagnostic models

Partial-Mastery Cognitive Diagnosis Models