Abstract:The continuous application of artificial intelligence (AI) technologies in online education has led to significant progress, especially in the field of Intelligent Tutoring Systems (ITS), online courses and learning management systems (LMS). An important research direction of the field is to provide students with customised learning trajectories via student modelling. Previous studies have shown that customisation of learning trajectories could effectively improve students' learning experiences and outcomes. However, training an ITS that can customise students' learning trajectories suffers from cold-start, time-consumption, human labour-intensity, and cost problems. One feasible approach is to simulate real students' behaviour trajectories through algorithms, to generate data that could be used to train the ITS. Nonetheless, implementing high-accuracy student modelling methods that effectively address these issues remains an ongoing challenge. Traditional simulation methods, in particular, encounter difficulties in ensuring the quality and diversity of the generated data, thereby limiting their capacity to provide intelligent tutoring systems (ITS) with high-fidelity and diverse training data. We thus propose Sim-GAIL, a novel student modelling method based on generative adversarial imitation learning (GAIL). To the best of our knowledge, it is the first method using GAIL to address the challenge of lacking training data, resulting from the issues mentioned above. We analyse and compare the performance of Sim-GAIL with two traditional Reinforcement Learning-based and Imitation Learning-based methods using action distribution evaluation, cumulative reward evaluation, and offline-policy evaluation. The experiments demonstrate that our method outperforms traditional ones on most metrics. Moreover, we apply our method to a domain plagued by the cold-start problem, knowledge tracing (KT), and the results show that our novel method could effectively improve the KT model's prediction accuracy in a cold-start scenario.

Simulating Student Interactions with Two-stage Imitation Learning for Intelligent Educational Systems

Off-Dynamics Inverse Reinforcement Learning

Sim-GAIL: A generative adversarial imitation learning approach of student modelling for intelligent tutoring systems

How To Guide Your Learner: Imitation Learning with Active Adaptive Expert Involvement

Offline Imitation Learning with a Misspecified Simulator.

Leveraging generative artificial intelligence to simulate student learning behavior

M 2 Sim: A Long-Term Interactive Driving Simulator.

Learning Interactive Real-World Simulators

A Learned Simulation Environment to Model Student Engagement and Retention in Automated Online Courses

Long-Term Interactive Driving Simulation: MPC to the Rescue.

KuaiSim: A Comprehensive Simulator for Recommender Systems

Toward Simulating Environments in Reinforcement Learning Based Recommendations.

Student Modeling and Analysis in Adaptive Instructional Systems

Learning to Simulate Daily Activities via Modeling Dynamic Human Needs

Extrinsicaly Rewarded Soft Q Imitation Learning with Discriminator

CogSimulator: A Model for Simulating User Cognition & Behavior with Minimal Data for Tailored Cognitive Enhancement

Online Learning in Iterated Prisoner's Dilemma to Mimic Human Behavior

When Large Language Model based Agent Meets User Behavior Analysis: A Novel User Simulation Paradigm

EduAgent: Generative Student Agents in Learning

IRASim: Learning Interactive Real-Robot Action Simulators

An Interaction Design for Machine Teaching to Develop AI Tutors