Process mining for self-regulated learning assessment in e-learning

R. Cerezo,A. Bogarin,M. Esteban,C. Romero

DOI: https://doi.org/10.1007/s12528-019-09225-y

2024-02-11

Abstract:Content assessment has broadly improved in e-learning scenarios in recent decades. However, the eLearning process can give rise to a spatial and temporal gap that poses interesting challenges for assessment of not only content, but also students' acquisition of core skills such as self-regulated learning. Our objective was to discover students' self-regulated learning processes during an eLearning course by using Process Mining Techniques. We applied a new algorithm in the educational domain called Inductive Miner over the interaction traces from 101 university students in a course given over one semester on the Moodle 2.0 platform. Data was extracted from the platform's event logs with 21629 traces in order to discover students' self-regulation models that contribute to improving the instructional process. The Inductive Miner algorithm discovered optimal models in terms of fitness for both Pass and Fail students in this dataset, as well as models at a certain level of granularity that can be interpreted in educational terms, which are the most important achievement in model discovery. We can conclude that although students who passed did not follow the instructors' suggestions exactly, they did follow the logic of a successful self-regulated learning process as opposed to their failing classmates. The Process Mining models also allow us to examine which specific actions the students performed, and it was particularly interesting to see a high presence of actions related to forum-supported collaborative learning in the Pass group and an absence of those in the Fail group.

Computers and Society,Machine Learning

What problem does this paper attempt to address?

The paper primarily explores how to use Process Mining (PM) technology to evaluate students' Self-Regulated Learning (SRL) abilities in an e-Learning environment. Specifically, the research aims to:

1. **Discover the self-regulated learning processes of students in e-Learning courses**: By utilizing process mining techniques to reveal the behavioral patterns of students engaging in self-regulated learning in online courses.

2. **Assess SRL skills**: By analyzing the interaction trace data generated by 101 university students on the Moodle 2.0 platform over a semester, the study investigates methods for assessing self-regulated learning skills.

3. **Apply new algorithms**: For the first time in the educational field, a new algorithm called the "Inductive Miner" is used to discover higher quality process models that better reflect the SRL behaviors of students who pass and fail the courses.

4. **Improve model interpretability**: By increasing data granularity (i.e., dividing data by course units), the readability and usability of the models are improved, enabling educators to better understand students' learning paths.

The research results indicate that the Inductive Miner algorithm can produce better model fitness values, meaning it can accurately reproduce students' interaction records on the Moodle platform. Additionally, by grouping data by course units, student behaviors can be analyzed in more detail, resulting in more interpretable models. Students who successfully passed the courses, although not fully following the teacher's recommendations, exhibited more reasonable and self-regulated learning processes, particularly actions related to collaborative learning supported by forums, which were more evident in the group of students who passed the courses.