Abstract:Background and Context In today's tech-driven world, programming courses are crucial. Yet, teaching programming is challenging, leading to high student failure rates. Understanding student learning patterns is key, but there's a lack of research utilizing tools to automatically collect and analyze interaction data for insights into student performance and behaviors. Objectives Study aims to compare problem-solving behaviors of novice and competent programmers during coding tests, identifying patterns and exploring relationships with program correctness. Method We built an online system with programming challenges to collect behavior data from novice and competent programmers. Our system analyzed data using various metrics to explore behavior-program correctness relationships. Findings Analysis showed distinct problem-solving behavior patterns. Competent programmers had fewer syntax errors, spent less time fixing bugs, and had higher program correctness. Novices made more syntax errors and spent more time fixing coding errors. Both groups used tabs for code structure, but competent programmers introduced unfamiliar variables more often and commented on them afterward. Emphasizing iterative revisions and active engagement enhances problem-solving skills and programming proficiency. Radar charts are effective for identifying improvement areas in teaching programming. The relationship between behavior and program correctness was positively correlated for competent programmers but not novices. Implications Study findings have implications for programming education. Radar charts help teachers identify course improvement areas. Novices can learn from competent programmers' behavior. Instructors should encourage continuous skill improvement through revisions and engagement. Identified unfamiliar programming aspects offer insights for targeted learning.

Automatically Generated and Graded Program Tracing Quizzes with Feedback

Automated Code Tracing Exercises for CS1

Let's Ask Students About Their Programs, Automatically

Testing and Debugging Habits of Intermediate Student Programmers

Analyzing Novice and Competent Programmers' Problem-Solving Behaviors Using an Automated Evaluation System

Automated Questions About Learners' Own Code Help to Detect Fragile Knowledge

Automated Generation of Computer Graded Unit Testing-Based Programming Assessments for Education

Auto-Generating Visual Exercises for Learning Program Semantics

Code Generation Based Grading: Evaluating an Auto-grading Mechanism for "Explain-in-Plain-English" Questions

Automatic Grading and Feedback using Program Repair for Introductory Programming Courses

Automatic Assessment of the Design Quality of Student Python and Java Programs

Write a Line: Tests with Answer Templates and String Completion Hints for Self-Learning in a CS1 Course

Teaching the art of functional programming using automated grading (experience report)

Program Slicing Technique in Programming Assessment

Adaptive Scaffolding in Block-Based Programming via Synthesizing New Tasks as Pop Quizzes

Utilizing programming traces to explore and model the dimensions of novices' code‐writing skill

Automatic grading system for C programming examination oriented to assessment of comprehensive practical abilities

Teaching Python programming with automatic assessment and feedback provision

Giving Feedback on Interactive Student Programs with Meta-Exploration

Students Struggle to Explain Their Own Program Code

Grading Programs Based on Hybrid Analysis.