Abstract:Knowledge Tracing (KT) is a research field that aims to estimate a student's knowledge state through learning interactions-a crucial component of Intelligent Tutoring Systems (ITSs). Despite significant advancements, no current KT models excel in both predictive accuracy and interpretability. Meanwhile, Large Language Models (LLMs), pre-trained on vast natural language datasets, have emerged as powerful tools with immense potential in various educational applications. This systematic review explores the intersections, opportunities, and challenges of combining KT models and LLMs in educational contexts. The review first investigates LLM applications in education, including their adaptability to domain-specific content and ability to support personalized learning. It then examines the development and current state of KT models, from traditional to advanced approaches, aiming to uncover potential challenges that LLMs could mitigate. The core of this review focuses on integrating LLMs with KT, exploring three primary functions: addressing general concerns in KT fields, overcoming specific KT model limitations, and performing as KT models themselves. Our findings reveal that LLMs can be customized for specific educational tasks through tailor-making techniques such as in-context learning and agent-based approaches, effectively managing complex and unbalanced educational data. These models can enhance existing KT models' performance and solve cold-start problems by generating relevant features from question data. However, both current models depend heavily on structured, limited datasets, missing opportunities to use diverse educational data that could offer deeper insights into individual learners and support various educational settings.

Knowledge Tracing As Language Processing: A Large-Scale Autoregressive Paradigm

A Deeper Knowledge Tracking Model Integrating Cognitive Theory and Learning Behavior

Recent Advances on Deep Learning Based Knowledge Tracing

Deep Attentive Model for Knowledge Tracing.

Towards Interpretable Deep Learning Models for Knowledge Tracing

XKT: Towards Explainable Knowledge Tracing Model with Cognitive Learning Theories for Questions of Multiple Knowledge Concepts

Interpreting Deep Learning Models for Knowledge Tracing

EDKT: An Extensible Deep Knowledge Tracing Model for Multiple Learning Factors

Programming Knowledge Tracing: A Comprehensive Dataset and A New Model

An Empirical Comparison of Deep Learning Models for Knowledge Tracing on Large-Scale Dataset

A Question-centric Multi-experts Contrastive Learning Framework for Improving the Accuracy and Interpretability of Deep Sequential Knowledge Tracing Models

Language Model Can Do Knowledge Tracing: Simple but Effective Method to Integrate Language Model and Knowledge Tracing Task

AAKT: Enhancing Knowledge Tracing with Alternate Autoregressive Modeling

BiRNN-DKT - Transfer Bi-directional LSTM RNN for Knowledge Tracing.

A Deep Knowledge Tracing Model Based on Multi-Head Self-Attention Mechanism

Convolutional Recurrent Neural Networks for Knowledge Tracing

ADKT: Adaptive Deep Knowledge Tracing

pyKT: A Python Library to Benchmark Deep Learning based Knowledge Tracing Models

Mitigating Cold-Start Problems in Knowledge Tracing with Large Language Models: an Attribute-aware Approach

A Systematic Review of Knowledge Tracing and Large Language Models in Education: Opportunities, Issues, and Future Research

Improving Interpretability of Deep Sequential Knowledge Tracing Models with Question-centric Cognitive Representations