Abstract:Artificial neural networks (ANNs) have shown to be amongst the most important artificial intelligence (AI) techniques in educational applications, providing adaptive educational services. However, their educational potential is limited in practice due to three major challenges: i) difficulty in incorporating symbolic educational knowledge (e.g., causal relationships, and practitioners' knowledge) in their development, ii) learning and reflecting biases, and iii) lack of interpretability. Given the high-risk nature of education, the integration of educational knowledge into ANNs becomes crucial for developing AI applications that adhere to essential educational restrictions, and provide interpretability over the predictions. This research argues that the neural-symbolic family of AI has the potential to address the named challenges. To this end, it adapts a neural-symbolic AI framework and accordingly develops an approach called NSAI, that injects and extracts educational knowledge into and from deep neural networks, for modelling learners computational thinking. Our findings reveal that the NSAI approach has better generalizability compared to deep neural networks trained merely on training data, as well as training data augmented by SMOTE and autoencoder methods. More importantly, unlike the other models, the NSAI approach prioritises robust representations that capture causal relationships between input features and output labels, ensuring safety in learning to avoid spurious correlations and control biases in training data. Furthermore, the NSAI approach enables the extraction of rules from the learned network, facilitating interpretation and reasoning about the path to predictions, as well as refining the initial educational knowledge. These findings imply that neural-symbolic AI can overcome the limitations of ANNs in education, enabling trustworthy and interpretable applications.

Emergence of machine language: towards symbolic intelligence with neural networks

Emergence of Symbols in Neural Networks for Semantic Understanding and Communication

Unified Representations for Learning and Reasoning

Discrete and continuous representations and processing in deep learning: Looking forward

Computational principles of intelligence: learning and reasoning with neural networks

Bridging the Gap: Representation Spaces in Neuro-Symbolic AI

From Latent Dynamics to Meaningful Representations

On the Transition from Neural Representation to Symbolic Knowledge

Neuro-Symbolic AI: Explainability, Challenges, and Future Trends

Can computers understand words like humans do? Comparable semantic representation in neural and computer systems

Where We Have Arrived in Proving the Emergence of Sparse Symbolic Concepts in AI Models

Symbolic Learning Enables Self-Evolving Agents

Symbolic Techniques for Deep Learning: Challenges and Opportunities

Mapping the Neuro-Symbolic AI Landscape by Architectures: A Handbook on Augmenting Deep Learning Through Symbolic Reasoning

Learning Continuous Semantic Representations of Symbolic Expressions

Symbolic, Distributed and Distributional Representations for Natural Language Processing in the Era of Deep Learning: a Survey

A survey on neural-symbolic learning systems

Neurosymbolic AI -- Why, What, and How

Converging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Empowered Autonomous Agents

Understanding Dynamics of Nonlinear Representation Learning and Its Application

Augmenting deep neural networks with symbolic knowledge: Towards trustworthy and interpretable AI for education