Evaluation of Study Plans using Partial Orders

Christian Rennert,Mahsa Pourbafrani,Wil van der Aalst
2024-10-22
Abstract:In higher education, data is collected that indicate the term(s) that a course is taken and when it is passed. Often, study plans propose a suggested course order to students. Study planners can adjust these based on detected deviations between the proposed and actual order of the courses being taken. In this work, we detect deviations by combining (1) the deviation between the proposed and actual course order with (2) the temporal difference between the expected and actual course-taking term(s). Partially ordered alignments identify the deviations between the proposed and actual order. We compute a partial order alignment by modeling a study plan as a process model and a student's course-taking behavior as a partial order. Using partial orders in such use cases allows one to relax the constraints of strictly ordered traces. This makes our approach less prone to the order in which courses are offered. Further, when modeling course-taking behavior as partial orders, we propose distinguishing intended course-taking behavior from actual course-passing behavior of students by including either all terms in which a course is attempted or only the term that a course is passed, respectively. This provides more perspectives when comparing the proposed and actual course-taking behavior. The proposed deviation measuring approach is evaluated on real-life data from RWTH Aachen University.
Computers and Society,Databases
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to solve the problem of deviation between students' study plans and their actual course - taking behaviors in higher education. Specifically, the authors attempt to detect and quantify these deviations by combining the following two aspects: 1. **Deviation between the recommended course sequence and the actual course - taking sequence**: Researchers want to know whether students take courses according to the recommended study plans and, if there are deviations, what the specific manifestations of these deviations are. 2. **Time difference between the expected study semester and the actual study semester**: In addition to the course sequence, the research also focuses on which semester a student takes a certain course and how this differs from the expected schedule. To achieve this goal, the authors propose a method based on partial order alignments. This method models the study plan as a process model and the students' course - taking behaviors as partially ordered relations. In this way, the constraints on strict sequential trajectories can be relaxed, thereby reducing the impact caused by the different offering sequences of courses. Furthermore, the authors also propose to distinguish between students' **expected course - taking behaviors** and **actual behaviors of passing exams**, that is, including all semesters of attempting to take courses or only including the semesters of passing courses. This provides more perspectives to compare the recommended study plans and the actual course - taking behaviors. Finally, this method was evaluated on a real - data set to verify its effectiveness and practicality. Specifically, the research used data from RWTH Aachen University, analyzed the study plans of the Bachelor of Computer Science program in 2010 and 2018, and conducted a comparative analysis through the exam data in the event logs. ### Summary The main goal of this paper is to systematically analyze and improve study plans by introducing the method of partial order alignments, so as to help students complete their studies more effectively and reduce the situation of overdue graduation. This not only helps to improve the quality of education, but also can provide valuable decision - support for educational administrators.