Prerequisite Structure Discovery in Intelligent Tutoring Systems

Louis Annabi,Sao Mai Nguyen
DOI: https://doi.org/10.1109/icdl55364.2023.10364416
2024-01-18
Abstract:This paper addresses the importance of Knowledge Structure (KS) and Knowledge Tracing (KT) in improving the recommendation of educational content in intelligent tutoring systems. The KS represents the relations between different Knowledge Components (KCs), while KT predicts a learner's success based on her past history. The contribution of this research includes proposing a KT model that incorporates the KS as a learnable parameter, enabling the discovery of the underlying KS from learner trajectories. The quality of the uncovered KS is assessed by using it to recommend content and evaluating the recommendation algorithm with simulated students.
Computers and Society,Artificial Intelligence,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to automatically discover the knowledge structure (KS) from the interaction data between students and Intelligent Tutoring Systems (ITS) without relying on the domain knowledge provided by experts. Specifically, the author aims to reveal the prerequisite relationships in KS through machine - learning techniques and evaluate the effectiveness of the discovered KS in recommending educational content. ### Main Problems and Contributions 1. **Problems**: - Traditional ITS usually rely on the domain knowledge provided by experts to construct KS. However, these domain knowledge may be wrong, incomplete or unavailable. - The exercise sequences in publicly available datasets are usually designed according to expert knowledge, which may lead to data bias and affect the discovery of KS. - A method is needed to be able to automatically discover KS from students' interaction data without expert knowledge. 2. **Contributions**: - A new KT model - Prerequisite Knowledge Tracing (PKT) is proposed. This model takes KS as learnable parameters and can reveal the potential KS from student trajectory data. - Use a synthetic data generator to generate student trajectory data to ensure that the data is not affected by the existing domain knowledge, so as to more accurately evaluate the KS discovery algorithm. - Through quantitative and qualitative evaluation, the effectiveness of the proposed method in KS discovery and KS - based recommendation systems is verified. ### Method Overview - **PKT Model**: The PKT model assumes that the success rate of students in completing exercises depends on their mastery of relevant knowledge components (KC) and their prerequisite KCs. The model minimizes the binary cross - entropy loss between the predicted success rate and the actual result by optimizing parameters (including the adjacency matrix of KS). \[ p_{e,s,t} = p_g+(1 - p_s - p_g)\sigma\left(\text{softmin}_{k \in P_e}\lambda_{s,k,t}-\delta_e\right) \] where: - \(p_g\) and \(p_s\) represent the guessing and slipping probabilities respectively. - \(\sigma\) represents the sigmoid function. - \(\lambda_{s,k,t}\) represents the skill level of student \(s\) for the \(k\) - th KC at time \(t\). - \(\delta_e\) represents the difficulty of exercise \(e\). - \(P_e\) represents the set of KCs related to exercise \(e\) and their prerequisite KCs. - **ZPDES - KS Algorithm**: This algorithm constructs a personalized exercise pool based on the discovered KS to ensure that the recommended exercises are neither too easy nor too difficult, thereby maximizing the learning progress and maintaining the students' intrinsic motivation. ### Experimental Results - **KS Discovery**: Experiments show that the PKT method performs better than other methods on random exercise sequence data, especially when dealing with unbiased data. - **Recommendation System Performance**: The recommendation system constructed using the discovered KS performs well in improving the overall skill level of students, even exceeding the recommendation system based on the trained KT model. In conclusion, this paper proposes a novel KS discovery method and verifies its effectiveness and potential in intelligent tutoring systems.