AAKT: Enhancing Knowledge Tracing with Alternate Autoregressive Modeling

Hao Zhang,Wenge Rong,Jianfei Zhang,Qing Sun,Yuanxin Ouyang,Zhang Xiong
DOI: https://doi.org/10.36227/techrxiv.24487747
2023-01-01
Abstract:Knowledge Tracing (KT) aims to predict students’ future performances based on their former exercises and additional information in educational settings. KT has received much attention since it provides personalized experiences in educational situations. The autoregressive modeling on the sequence of former exercises has been proven effective for this task. One of the main challenges for autoregressive modeling in KT lies in the different visibility of exercise information, which leads to sacrifice on effectiveness in previous methods. To address this issue, we propose the Alternate Autoregressive Knowledge Tracing (AAKT) framework by combining question and response sequences into a unique sequence in an alternate order and using sliding windows to cut subsequences for training and testing. The model embeds exercise information into vectors through embedding layers and an auxiliary task during the training process. Advanced autoregressive technologies from Natural Language Generation (NLG) are introduced to extract information from historical interactions. The output of the autoregressive model is transformed into the probability of answering correctly for the given question. We compare AAKT with several knowledge tracing baselines on four real-world datasets and the experimental studies demonstrate its promising potential. Ablation studies and visualizations are also conducted to validate the effects of several key components of AAKT.
What problem does this paper attempt to address?