Abstract:Knowledge Tracing is a crucial aspect of personalized learning that aims to track the evolving knowledge states of students with respect to one or more concepts. However, existing literature either models knowledge state for each predefined concept separately, potentially overlooking the underlying interrelationships between concepts, or lacks the capability to uncover long-term dependencies within a historical sequence of questions. Furthermore, they have limitations in precisely identifying the mastery level of individual learners for specific concepts. In order to address these problems, we propose a novel deep learning-based knowledge tracing model, named Bayesian Cognitive-aware Key-Value Memory Network (BCKVMN). BCKVMN combines the strengths of Dynamic Key-Value Memory Network (DKVMN), Long Short-Term Memory (LSTM), embedding layer, and Bayesian theory. To capture long-term dependencies in question sequences and contextual information, we extend DKVMN by incorporating a standard LSTM module that integrates cognitive processes observed in human learning. Additionally, we employ an embedding layer to uncover the influence of question difficulty on final predictions. Furthermore, we introduce Bayesian theory to enhance parameter interpretation for the model. To investigate complex representation of human learning, our approach considers not only three distinct learning states during the learning process but also the relationships between underlying concepts and students' mastery levels for each concept. Experimental evaluations are conducted on the three real-world datasets Algebra200, ASSISTMENTS2009 and ASSISTMENTS2017. The results have demonstrated that the proposed model outperforms state-of-the-art methods (achieving nearly 7% improvement in AUC in some cases) while achieving a better balance between performance and interpretability.

Learning meets Assessment: On the relation between Item Response Theory and Bayesian Knowledge Tracing

Bayesian analysis of dynamic item response models in educational testing

Bayesian knowledge tracing, logistic models, and beyond: an overview of learner modeling techniques

Uncertainty-preserving deep knowledge tracing with state-space models

Applying the Network Item Response Model to Student Assessment Data

Item Response Theory -- A Statistical Framework for Educational and Psychological Measurement

Deep Knowledge Tracing is an implicit dynamic multidimensional item response theory model

Mapping unobserved item-respondent interactions: A latent space item response model with interaction map

An Introduction to Network Psychometrics: Relating Ising Network Models to Item Response Theory Models

Bayesian Nonparametric Monotone Regression of Dynamic Latent Traits in Item Response Theory Models

A Temporal Convolutional Knowledge Tracing Model Integrating Forgetting Factors and Item Response Theory

Bayesian Mixed Effects Model and Data Visualization for Understanding Item Response Time and Response Order in Open Online Assessment

CS-BKT: Introducing Item Relationship to the Bayesian Knowledge Tracing Model

Explore Bayesian Analysis in Cognitive-aware Key-Value Memory Networks for Knowledge Tracing in Online Learning

Deep-IRT: Make Deep Learning Based Knowledge Tracing Explainable Using Item Response Theory

A Deeper Knowledge Tracking Model Integrating Cognitive Theory and Learning Behavior

Time-and-Concept Enhanced Deep Multidimensional Item Response Theory for interpretable Knowledge Tracing

Bayes Nets in Educational Assessment: Where Do the Numbers Come From?

A Doubly Latent Space Joint Model for Local Item and Person Dependence in the Analysis of Item Response Data

Markov chain models for inspecting response dynamics in psychological testing

Assessing Preknowledge Cheating via Innovative Measures: A Multiple-Group Analysis of Jointly Modeling Item Responses, Response Times, and Visual Fixation Counts