Abstract:Cognitive diagnosis models map observations onto psychological internal traits, which have been widely used to construct personalized educational assessments. However, the challenges of the latent ability representation, accurate performance with explanatory and cold-start problems caused by limited handcraft skills still exist. In this paper, we introduce a selfadaptive Attention Gate Cognitive Diagnosis Model (AGCDM) based on a multi-layer hierarchical structure. Specifically, in the first two layers, our model embeds the item response logs into a higher expressive latent space, and the specific self-attention mechanism captures the rich information from the inner-dependencies correlation among the examinee, quiz and knowledge. In the next layer, the gate mechanism addresses the challenge of noisy information (slip and guess) over psychological reasons. We verify the empirical performance of our model on different educational tasks and all comparisons study conducted on the same training recipe. On the item response prediction task, the experiment results demonstrate our hierarchical model achieves state-of-the-art performance. Through the estimation of adaptive learning, we also validate the model’s effectiveness in addressing the limited skill problem in real scenarios. The learning tracks show that our model empowered by the meta-learning algorithm can be adaptive faster than the base model to the new different skill distribution set. Furthermore, we present the ablation study on the hierarchical architecture and detailed hyperparameters selections. The comparison results demonstrate the attention blocks yield the scores improvement, and the estimation of the noisy errors shows the gate mechanism boosts the detection accuracy on the slip and guess. Code is available at https://github.com/TerryPei/AGCDM.

A Mixture Fluency model using responses and response times with cognitive diagnosis model framework

A Mixture Response Time Process Model for Aberrant Behaviors and Item Nonresponses

A Mixture Model for Random Responding Behavior in Forced-Choice Noncognitive Assessment: Implication and Application in Organizational Research

A Mixture Cure-Rate Model for Responses and Response Times in Time-Limit Tests

Contributions to the statistical analysis of item response time in educational testing

Exploring Multiple Strategic Problem Solving Behaviors in Educational Psychology Research by Using Mixture Cognitive Diagnosis Model

Concurrent Use of Response Time and Response Accuracy for Detecting Examinees with Item Preknowledge

Detecting Aberrant Behavior and Item Preknowledge: A Comparison of Mixture Modeling Method and Residual Method

Self-Attention Gated Cognitive Diagnosis For Faster Adaptive Educational Assessments

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

A Mixture Response Model for Identifying Item Preknowledge

A Two-Stage Approach to Differentiating Normal and Aberrant Behavior in Computer Based Testing

A Constrained Factor Mixture Model for Detecting Careless Responses that is Simple to Implement

Diagnosing Writing Ability Using China’s Standards of English Language Ability: Application of Cognitive Diagnosis Models

Fuzzy Cognitive Diagnosis for Modelling Examinee Performance

Exploring Latent Constructs through Multimodal Data Analysis

HeckmanCD: Exploiting Selection Bias in Cognitive Diagnosis

Cognitive Modelling for Predicting Examinee Performance

A Diagnostic Facet Status Model (DFSM) for Extracting Instructionally Useful Information from Diagnostic Assessment

Young ischaemic stroke in South Auckland: a hospital-based study.

New development of cognitive diagnosis models