Abstract:Online education is playing a more and more important role in today's education. The key link of online education is to model students' knowledge mastery according to their historical behaviors, so as to obtain the knowledge tracing represented by students' current knowledge state. Previous Transformer-based knowledge tracing models have disadvantages such as inefficient model computation and redundant information on the one hand. On the other hand, the traditional knowledge tracing model cannot solve the problem of imbalanced positive and negative samples in the data well. In order to better model the current knowledge state of students, this paper proposes a knowledge tracing model based on the collaborative multi-head attention mechanism. The model uses a collaborative multi-head attention mechanism to solve the information redundancy problem in the previous Transformer-based knowledge tracing model, and improves the computational efficiency and performance of the model. The model also introduces a focal loss function, which not only solves the problem of imbalanced question labeling divisions in knowledge tracing but also improves the differentiation of difficulty level among the questions and enhances the accuracy of model prediction. The experimental results on three public experimental datasets show that the knowledge tracing model based on the collaborative multi-head attention mechanism proposed in this paper outperforms other recent knowledge tracing models in terms of evaluation metric AUC and also has better performance in predicting students' responses.

A Deep Learning Knowledge Tracing Model Based on Attention Mechanism

A Novel Knowledge Tracing Model Based on Collaborative Multi-Head Attention

A Deeper Knowledge Tracking Model Integrating Cognitive Theory and Learning Behavior

Self-attention Based GRU Neural Network for Deep Knowledge Tracing

What is wrong with deep knowledge tracing? Attention-based knowledge tracing

Embedding cognitive framework with self-attention for interpretable knowledge tracing

EAKT: Embedding Cognitive Framework with Attention for Interpretable Knowledge Tracing

Augmenting Interpretable Knowledge Tracing by Ability Attribute and Attention Mechanism

ELAKT: Enhancing Locality for Attentive Knowledge Tracing

A study of progressive data flow knowledge tracing based on reconstructed attention mechanism

Application of Deep Self-Attention in Knowledge Tracing

Interpreting Deep Learning Models for Knowledge Tracing

Learning consistent representations with temporal and causal enhancement for knowledge tracing

Tracing Knowledge Instead of Patterns: Stable Knowledge Tracing with Diagnostic Transformer

KT-XL - A Knowledge Tracing Model for Predicting Learning Performance Based on Transformer-XL.

Time Interval Aware Self-Attention approach for Knowledge Tracing?

Deep Knowledge Tracing with Side Information

A Temporal Convolutional Knowledge Tracing Model Integrating Forgetting Factors and Item Response Theory

Incorporating Rich Features into Deep Knowledge Tracing

A Self-Attentive model for Knowledge Tracing

Improving the performance and explainability of knowledge tracing via Markov blanket