Abstract:Over recent decades, machine learning, an integral subfield of artificial intelligence, has revolutionized diverse sectors, enabling data-driven decisions with minimal human intervention. In particular, the field of educational assessment emerges as a promising area for machine learning applications, where students can be classified and diagnosed using their performance data. The objectives of Diagnostic Classification Models (DCMs), which provide a suite of methods for diagnosing students' cognitive states in relation to the mastery of necessary cognitive attributes for solving problems in a test, can be effectively addressed through machine learning techniques. However, the challenge lies in the latent nature of cognitive status, which makes it difficult to obtain labels for the training dataset. Consequently, the application of machine learning methods to DCMs often assumes smaller training sets with labels derived either from theoretical considerations or human experts. In this study, the authors propose a supervised diagnostic classification model with data augmentation (SDCM-DA). This method is designed to utilize the augmented data using a data generation model constructed by leveraging the probability of correct responses for each attribute mastery pattern derived from the expert-labeled dataset. To explore the benefits of data augmentation, a simulation study is carried out, contrasting it with classification methods that rely solely on the expert-labeled dataset for training. The findings reveal that utilizing data augmentation with the estimated probabilities of correct responses substantially enhances classification accuracy. This holds true even when the augmentation originates from a small labeled sample with occasional labeling errors, and when the tests contain lower-quality items that may inaccurately measure students' true cognitive status. Moreover, the study demonstrates that leveraging augmented data for learning can enable the successful classification of students, thereby eliminating the necessity for specifying an underlying response model.

Diagnostic Classification Models for Testlets: Methods and Theory

A Testlet Diagnostic Classification Model with Attribute Hierarchies

Validating a Reading Assessment Within the Cognitive Diagnostic Assessment Framework: Q-Matrix Construction and Model Comparisons for Different Primary Grades

On the Identifiability of Diagnostic Classification Models.

Diagnostic Classification Models: Recent Developments, Practical Issues, and Prospects

A One‐Parameter Diagnostic Classification Model with Familiar Measurement Properties

Statistical Analysis Ofq-Matrix Based Diagnostic Classification Models

Explanatory Cognitive Diagnostic Models: Incorporating Latent and Observed Predictors

Modification Indices for Diagnostic Classification Models

A Graphical Diagnostic Classification Model

Sufficient and Necessary Conditions for the Identifiability of DINA Models with Polytomous Responses

Statistical Applications to Cognitive Diagnostic Testing

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

A Diagnostic Facet Status Model (DFSM) for Extracting Instructionally Useful Information from Diagnostic Assessment

Supervised diagnostic classification of cognitive attributes using data augmentation

A Semi-supervised Learning Method for Q-Matrix Specification Under the DINA and DINO Model With Independent Structure

A Comparison of Differential Item Functioning Detection Methods in Cognitive Diagnostic Models

New development of cognitive diagnosis models

Modeling Hierarchical Attribute Structures in Diagnostic Classification Models with Multiple Attempts

Applying Unidimensional and Multidimensional Item Response Theory Models in Testlet-Based Reading Assessment

The selection of cognitive diagnostic models for a reading comprehension test