Improving Feedback from Automated Reviews of Student Spreadsheets

Sören Aguirre Reid,Frank Kammer,Jonas-Ian Kuche,Pia-Doreen Ritzke,Markus Siepermann,Max Stephan,Armin Wagenknecht
2023-10-14
Abstract:Spreadsheets are one of the most widely used tools for end users. As a result, spreadsheets such as Excel are now included in many curricula. However, digital solutions for assessing spreadsheet assignments are still scarce in the teaching context. Therefore, we have developed an Intelligent Tutoring System (ITS) to review students' Excel submissions and provide individualized feedback automatically. Although the lecturer only needs to provide one reference solution, the students' submissions are analyzed automatically in several ways: value matching, detailed analysis of the formulas, and quality assessment of the solution. To take the students' learning level into account, we have developed feedback levels for an ITS that provide gradually more information about the error by using one of the different analyses. Feedback at a higher level has been shown to lead to a higher percentage of correct submissions and was also perceived as well understandable and helpful by the students.
Computers and Society
What problem does this paper attempt to address?
The paper attempts to address the problem of automatically evaluating students' spreadsheet assignments in a teaching environment and providing personalized feedback. Specifically, the paper develops an Intelligent Tutoring System (ITS) that can automatically assess students' Excel submissions based on reference answers and provide hierarchical feedback. This feedback ranges from simple correctness judgments to detailed error type analysis and specific improvement suggestions, aiming to help students gradually identify and correct errors, ultimately enhancing their spreadsheet application skills. Compared to existing systems that can only detect errors but cannot automatically generate feedback, this ITS system can provide more comprehensive and targeted feedback with minimal effort from teachers, thereby promoting the development of students' self-learning abilities.