Abstract:How do we make sense of the input from our sensory organs, and put the perceived information into context of our past experiences? The hippocampal-entorhinal complex plays a major role in the organization of memory and thought. The formation of and navigation in cognitive maps of arbitrary mental spaces via place and grid cells can serve as a representation of memories and experiences and their relations to each other. The multi-scale successor representation is proposed to be the mathematical principle underlying place and grid cell computations. Here, we present a neural network, which learns a cognitive map of a semantic space based on 32 different animal species encoded as feature vectors. The neural network successfully learns the similarities between different animal species, and constructs a cognitive map of 'animal space' based on the principle of successor representations with an accuracy of around 30% which is near to the theoretical maximum regarding the fact that all animal species have more than one possible successor, i.e. nearest neighbor in feature space. Furthermore, a hierarchical structure, i.e. different scales of cognitive maps, can be modeled based on multi-scale successor representations. We find that, in fine-grained cognitive maps, the animal vectors are evenly distributed in feature space. In contrast, in coarse-grained maps, animal vectors are highly clustered according to their biological class, i.e. amphibians, mammals and insects. This could be a putative mechanism enabling the emergence of new, abstract semantic concepts. Finally, even completely new or incomplete input can be represented by interpolation of the representations from the cognitive map with remarkable high accuracy of up to 95%. We conclude that the successor representation can serve as a weighted pointer to past memories and experiences, and may therefore be a crucial building block to include prior knowledge, and to derive context knowledge from novel input. Thus, our model provides a new tool to complement contemporary deep learning approaches on the road towards artificial general intelligence.

HINT: Hierarchical Neuron Concept Explainer

Cause and Effect: Hierarchical Concept-based Explanation of Neural Networks

CHAIN: Concept-harmonized Hierarchical Inference Interpretation of Deep Convolutional Neural Networks

Interpreting Bottom-Up Decision-Making of CNNs via Hierarchical Inference

Using Single-Neuron Representations for Hierarchical Concepts as Abstractions of Multi-Neuron Representations

A Self-explaining Neural Architecture for Generalizable Concept Learning

Learning Hierarchically Structured Concepts

Understanding Neural Network Through Neuron Level Visualization.

<i>Neuro</i>Explainer: Fine-Grained Attention Decoding to Uncover Cortical Development Patterns of Preterm Infants

Hierarchical Interpretation of Neural Text Classification

ConceptExplainer: Interactive Explanation for Deep Neural Networks from a Concept Perspective

WWW: A Unified Framework for Explaining What, Where and Why of Neural Networks by Interpretation of Neuron Concepts

Concept backpropagation: An Explainable AI approach for visualising learned concepts in neural network models

LLM-assisted Concept Discovery: Automatically Identifying and Explaining Neuron Functions

Leveraging Prior Concept Learning Improves Generalization From Few Examples in Computational Models of Human Object Recognition

Neural Information Processing in Hierarchical Prototypical Networks

Hierarchical Explanations for Video Action Recognition

Hierarchical interpretations for neural network predictions

Neural network based formation of cognitive maps of semantic spaces and the putative emergence of abstract concepts

Multi-Neuron Representations of Hierarchical Concepts in Spiking Neural Networks

Hierarchical Semantic Tree Concept Whitening for Interpretable Image Classification