Abstract:Programming education has received extensive attention in recent years due to the increasing demand for programming ability in almost all industries. Educational institutions have widely employed online judges for programming training, which can help teachers automatically assess programming assignments by executing students’ code with test cases. However, a more important teaching process with online judges should be to evaluate how students master each of the programming skills such as strings or pointers, so that teachers may give personalized feedback and help them proceed to the success more efficiently. Previous studies have adopted deep models of knowledge tracing to evaluate a student’s mastery level of skills during the interaction with programming exercises. However, existing models generally follow the conventional assumption of knowledge tracing that each programming exercise requires only one skill, whereas in practice a programming exercise usually inspects the comprehensive use of multiple skills. Moreover, the feature of student code is often simply concatenated with other input features without the consideration of its relationship with the inspected programming skills. To bridge the gap, we propose a simple attention-based approach to learn from student code the features reflecting the multiple programming skills inspected by each programming exercise. In particular, we first use a program embedding method to obtain the representations of student code. Then we use the skill embeddings of each programming exercise to query the embeddings of student code and form an aggregated hidden state representing how the inspected skills are used in the student code. We combine the learned hidden state with DKT (Deep Knowledge Tracing), an LSTM (Long Short-Term Memory)-based knowledge tracing model, and show the improvements over baseline model. We point out some possible directions to improve the current work.

Inferring How Novice Students Learn to Code - Integrating Automated Program Repair with Cognitive Model.

Enhancing Code Language Models for Program Repair by Curricular Fine-tuning Framework

Repairing Bugs in Python Assignments Using Large Language Models

Exploring the Potential of Pre-Trained Language Models of Code for Automated Program Repair

HELP-DKT: an interpretable cognitive model of how students learn programming based on deep knowledge tracing

Programming Knowledge Tracing: A Comprehensive Dataset and A New Model

Iterative Knowledge Distillation through Feedback-Driven Learning Cycles

Enhancing Programming Knowledge Tracing by Interacting Programming Skills and Student Code

CREF: An LLM-based Conversational Software Repair Framework for Programming Tutors

Icd: A New Interpretable Cognitive Diagnosis Model for Intelligent Tutor Systems

Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistakes

FastFixer: An Efficient and Effective Approach for Repairing Programming Assignments

CursorCore: Assist Programming through Aligning Anything

How to Teach Programming in the AI Era? Using LLMs as a Teachable Agent for Debugging

CourseAssist: Pedagogically Appropriate AI Tutor for Computer Science Education

INTERVENOR: Prompting the Coding Ability of Large Language Models with the Interactive Chain of Repair

Peer-aided Repairer: Empowering Large Language Models to Repair Advanced Student Assignments

LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement

Online Programming Education Modeling and Knowledge Tracing.

Knowledge tracing: Modeling the acquisition of procedural knowledge

MoocRadar: A Fine-grained and Multi-aspect Knowledge Repository for Improving Cognitive Student Modeling in MOOCs