Abstract:Machine learning models are biased toward data seen during the training steps. The models will tend to give good results in classes where there are many examples and poor results in those with few examples. This problem generally occurs when the classes to predict are imbalanced and this is frequent in educational data where for example, there are skills that are very difficult or very easy to master. There will be less data on students that correctly answered questions related to difficult skills and who incorrectly answered those related to skills easy to master. In this paper, we tackled this problem by proposing a hybrid architecture combining Deep Neural Network architectures— especially Long Short-Term Memory (LSTM) and Convolutional Neural Networks (CNN)—with expert knowledge for user modeling. The proposed solution uses attention mechanism to infuse expert knowledge into the Deep Neural Network. It has been tested in two contexts: knowledge tracing in an intelligent tutoring system (ITS) called Logic-Muse and prediction of socio-moral reasoning in a serious game called MorALERT. The proposed solution is compared to state-of-the-art machine learning solutions and experiments show that the resulting model can accurately predict the current student's knowledge state (in Logic-Muse) and thus enable an accurate personalization of the learning process. Other experiments show that the model can also be used to predict the level of socio-moral reasoning skills (in MorALERT). Our findings suggest the need for hybrid neural networks that integrate prior expert knowledge (especially when it is necessary to compensate for the strong dependency—of deep learning methods—on data size or the possible unbalanced datasets). Many domains can benefit from such an approach to building models that allow generalization even when there are small training data.

Learning Personalized Modular Network Guided By Structured Knowledge

Modular neural network via exploring category hierarchy

Emergence and reconfiguration of modular structure for artificial neural networks during continual familiarity detection

Network Transplanting for the Functionally Modular Architecture.

Biologically Inspired Structure Learning with Reverse Knowledge Distillation for Spiking Neural Networks

Infusing Expert Knowledge Into a Deep Neural Network Using Attention Mechanism for Personalized Learning Environments

Multitask Learning With Enhanced Modules.

Evolving Modular Neural Networks Which Generalise Well

Modular Growth of Hierarchical Networks: Efficient, General, and Robust Curriculum Learning

MODENN: A Shallow Broad Neural Network Model Based on Multi-Order Descartes Expansion

Meta Module Network for Compositional Visual Reasoning

Self-Supervised Interpretable End-to-End Learning via Latent Functional Modularity

Learning to Reason: End-to-End Module Networks for Visual Question Answering

A Novel Approach to Lifelong Learning: the Plastic Support Structure

Modular meta-learning in abstract graph networks for combinatorial generalization

Designs to Improve Capability of Neural Networks to Make Structural Predictions

Knowledge-guided Semantic Computing Network

Emergence and reconfiguration of modular structure for synaptic neural networks during continual familiarity detection

Automatic Organization of Neural Modules for Enhanced Collaboration in Neural Networks

Task Decomposition and Module Combination Based on Class Relations: a Modular Neural Network for Pattern Classification

Modular Representation of Layered Neural Networks