Abstract:Knowledge tracing (KT) plays a crucial role in computer-aided education and intelligent tutoring systems, aiming to assess students' knowledge proficiency by predicting their future performance on new questions based on their past response records. While existing deep learning knowledge tracing (DLKT) methods have significantly improved prediction accuracy and achieved state-of-the-art results, they often suffer from a lack of interpretability. To address this limitation, current approaches have explored incorporating psychological influences to achieve more explainable predictions, but they tend to overlook the potential influences of historical responses. In fact, understanding how models make predictions based on response influences can enhance the transparency and trustworthiness of the knowledge tracing process, presenting an opportunity for a new paradigm of interpretable KT. However, measuring unobservable response influences is challenging. In this paper, we resort to counterfactual reasoning that intervenes in each response to answer \textit{what if a student had answered a question incorrectly that he/she actually answered correctly, and vice versa}. Based on this, we propose RCKT, a novel response influence-based counterfactual knowledge tracing framework. RCKT generates response influences by comparing prediction outcomes from factual sequences and constructed counterfactual sequences after interventions. Additionally, we introduce maximization and inference techniques to leverage accumulated influences from different past responses, further improving the model's performance and credibility. Extensive experimental results demonstrate that our RCKT method outperforms state-of-the-art knowledge tracing methods on four datasets against six baselines, and provides credible interpretations of response influences.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the lack of interpretability in Knowledge Tracing (KT). Although the existing Deep Learning Knowledge Tracing (DLKT) methods have achieved significant improvements in prediction accuracy and reached the state - of - the - art level, these methods are usually lack of interpretability. This means that they cannot clearly show how the model predicts students' future performance based on their past answer records. This opacity limits educators' trust and transparency in the model prediction results. To address this limitation, the paper proposes a new Response Influence - based Counterfactual Knowledge Tracing (RCKT) framework. RCKT intervenes in each response by introducing counterfactual reasoning techniques to evaluate the impact if a student answers a question wrong but actually answers it right, or vice versa. Specifically, RCKT generates response influence by comparing the prediction results between factual sequences and constructed counterfactual sequences. In addition, RCKT also introduces maximization and inference techniques to further improve the performance and credibility of the model by using the cumulative impact of different historical responses. Through this method, RCKT not only improves the prediction accuracy, but also enhances the interpretability of the model at the response level, enabling educators to more clearly understand the prediction process of the model, thereby improving the effectiveness and pertinence of teaching activities.

Interpretable Knowledge Tracing via Response Influence-based Counterfactual Reasoning

XKT: Towards Explainable Knowledge Tracing Model with Cognitive Learning Theories for Questions of Multiple Knowledge Concepts

Improving Interpretability of Deep Sequential Knowledge Tracing Models with Question-centric Cognitive Representations

A Deeper Knowledge Tracking Model Integrating Cognitive Theory and Learning Behavior

A Temporal Convolutional Knowledge Tracing Model Integrating Forgetting Factors and Item Response Theory

Stable Knowledge Tracing Using Causal Inference

Do We Fully Understand Students' Knowledge States? Identifying and Mitigating Answer Bias in Knowledge Tracing

Towards Interpretable Deep Learning Models for Knowledge Tracing

Knowledge ontology enhanced model for explainable knowledge tracing

Interpreting Deep Learning Models for Knowledge Tracing

FDKT: Towards an interpretable deep knowledge tracing via fuzzy reasoning

Model-agnostic counterfactual reasoning for identifying and mitigating answer bias in knowledge tracing

Interpretable Knowledge Tracing: Simple and Efficient Student Modeling with Causal Relations

A Question-centric Multi-experts Contrastive Learning Framework for Improving the Accuracy and Interpretability of Deep Sequential Knowledge Tracing Models

A survey of explainable knowledge tracing

Time-and-Concept Enhanced Deep Multidimensional Item Response Theory for interpretable Knowledge Tracing

Leveraging Pedagogical Theories to Understand Student Learning Process with Graph-based Reasonable Knowledge Tracing

Explainable Few-shot Knowledge Tracing

Programming Knowledge Tracing: A Comprehensive Dataset and A New Model

Deep Knowledge Tracing is an implicit dynamic multidimensional item response theory model