Abstract:Over recent decades, machine learning, an integral subfield of artificial intelligence, has revolutionized diverse sectors, enabling data-driven decisions with minimal human intervention. In particular, the field of educational assessment emerges as a promising area for machine learning applications, where students can be classified and diagnosed using their performance data. The objectives of Diagnostic Classification Models (DCMs), which provide a suite of methods for diagnosing students' cognitive states in relation to the mastery of necessary cognitive attributes for solving problems in a test, can be effectively addressed through machine learning techniques. However, the challenge lies in the latent nature of cognitive status, which makes it difficult to obtain labels for the training dataset. Consequently, the application of machine learning methods to DCMs often assumes smaller training sets with labels derived either from theoretical considerations or human experts. In this study, the authors propose a supervised diagnostic classification model with data augmentation (SDCM-DA). This method is designed to utilize the augmented data using a data generation model constructed by leveraging the probability of correct responses for each attribute mastery pattern derived from the expert-labeled dataset. To explore the benefits of data augmentation, a simulation study is carried out, contrasting it with classification methods that rely solely on the expert-labeled dataset for training. The findings reveal that utilizing data augmentation with the estimated probabilities of correct responses substantially enhances classification accuracy. This holds true even when the augmentation originates from a small labeled sample with occasional labeling errors, and when the tests contain lower-quality items that may inaccurately measure students' true cognitive status. Moreover, the study demonstrates that leveraging augmented data for learning can enable the successful classification of students, thereby eliminating the necessity for specifying an underlying response model.

Explanatory Cognitive Diagnostic Models: Incorporating Latent and Observed Predictors

Explanatory Cognitive Diagnosis Models Incorporating Item Features

New Paradigm of Identifiable General-response Cognitive Diagnostic Models: Beyond Categorical Data

Learning Latent and Hierarchical Structures in Cognitive Diagnosis Models

New development of cognitive diagnosis models

Partial-Mastery Cognitive Diagnosis Models

HeckmanCD: Exploiting Selection Bias in Cognitive Diagnosis

A Tutorial on Cognitive Diagnosis Modeling for Characterizing Mental Health Symptom Profiles Using Existing Item Responses

Modeling question difficulty for unbiased cognitive diagnosis: A causal perspective

In Search of Optimal Cognitive Diagnostic Model(s) for ESL Grammar Test Data

A Diagnostic Facet Status Model (DFSM) for Extracting Instructionally Useful Information from Diagnostic Assessment

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

Inferring Latent Structure in Polytomous Data with a Higher-Order Diagnostic Model

Towards the Identifiability and Explainability for Personalized Learner Modeling: an Inductive Paradigm

A One‐Parameter Diagnostic Classification Model with Familiar Measurement Properties

Supervised diagnostic classification of cognitive attributes using data augmentation

Diagnostic Classification Models for Testlets: Methods and Theory

Self-Attention Gated Cognitive Diagnosis For Faster Adaptive Educational Assessments

An Application of the Support Vector Machine for Attribute-By-Attribute Classification in Cognitive Diagnosis

A Testlet Diagnostic Classification Model with Attribute Hierarchies

Modeling Hierarchical Attribute Structures in Diagnostic Classification Models with Multiple Attempts