Abstract:Machine learning models are biased toward data seen during the training steps. The models will tend to give good results in classes where there are many examples and poor results in those with few examples. This problem generally occurs when the classes to predict are imbalanced and this is frequent in educational data where for example, there are skills that are very difficult or very easy to master. There will be less data on students that correctly answered questions related to difficult skills and who incorrectly answered those related to skills easy to master. In this paper, we tackled this problem by proposing a hybrid architecture combining Deep Neural Network architectures— especially Long Short-Term Memory (LSTM) and Convolutional Neural Networks (CNN)—with expert knowledge for user modeling. The proposed solution uses attention mechanism to infuse expert knowledge into the Deep Neural Network. It has been tested in two contexts: knowledge tracing in an intelligent tutoring system (ITS) called Logic-Muse and prediction of socio-moral reasoning in a serious game called MorALERT. The proposed solution is compared to state-of-the-art machine learning solutions and experiments show that the resulting model can accurately predict the current student's knowledge state (in Logic-Muse) and thus enable an accurate personalization of the learning process. Other experiments show that the model can also be used to predict the level of socio-moral reasoning skills (in MorALERT). Our findings suggest the need for hybrid neural networks that integrate prior expert knowledge (especially when it is necessary to compensate for the strong dependency—of deep learning methods—on data size or the possible unbalanced datasets). Many domains can benefit from such an approach to building models that allow generalization even when there are small training data.

Modeling the EdNet Dataset with Logistic Regression

Do we need to go Deep? Knowledge Tracing with Big Data

Development of a Neural Network for modeling the behavior of the Educational Process

Opening the Black Box of Neural Networks: Methods for Interpreting Neural Network Models in Clinical Applications

Modeling Student Performance in Game-Based Learning Environments

Learning Cognitive Models using Neural Networks

Design of a bioinspired augmented model for prediction of LD students via online behaviour analysis

Modeling failures in smart grids by a bilinear logistic regression approach

EdNet: A Large-Scale Hierarchical Dataset in Education

Infusing Expert Knowledge Into a Deep Neural Network Using Attention Mechanism for Personalized Learning Environments

EduAgent: Generative Student Agents in Learning

The Exploration of Modelling for The Student Achievement Predictor

Knowledge Distillation of LLM for Automatic Scoring of Science Education Assessments

A Deep Learning Approach to Behavior-Based Learner Modeling

Logistic Knowledge Tracing: A Constrained Framework for Learner Modeling

Advanced Neural Network Approach, Its Explanation with LIME for Credit Scoring Application

Modelling, prediction and classification of student academic performance using artificial neural networks

DiG-IN: Diffusion Guidance for Investigating Networks -- Uncovering Classifier Differences Neuron Visualisations and Visual Counterfactual Explanations

Admission Prediction in Undergraduate Applications: an Interpretable Deep Learning Approach

Embedding residuals in graph-based solutions: the E-ResSAGE and E-ResGAT algorithms. A case study in intrusion detection

On Training a Neural Network to Explain Binaries