Abstract:How do we make sense of the input from our sensory organs, and put the perceived information into context of our past experiences? The hippocampal-entorhinal complex plays a major role in the organization of memory and thought. The formation of and navigation in cognitive maps of arbitrary mental spaces via place and grid cells can serve as a representation of memories and experiences and their relations to each other. The multi-scale successor representation is proposed to be the mathematical principle underlying place and grid cell computations. Here, we present a neural network, which learns a cognitive map of a semantic space based on 32 different animal species encoded as feature vectors. The neural network successfully learns the similarities between different animal species, and constructs a cognitive map of 'animal space' based on the principle of successor representations with an accuracy of around 30% which is near to the theoretical maximum regarding the fact that all animal species have more than one possible successor, i.e. nearest neighbor in feature space. Furthermore, a hierarchical structure, i.e. different scales of cognitive maps, can be modeled based on multi-scale successor representations. We find that, in fine-grained cognitive maps, the animal vectors are evenly distributed in feature space. In contrast, in coarse-grained maps, animal vectors are highly clustered according to their biological class, i.e. amphibians, mammals and insects. This could be a putative mechanism enabling the emergence of new, abstract semantic concepts. Finally, even completely new or incomplete input can be represented by interpolation of the representations from the cognitive map with remarkable high accuracy of up to 95%. We conclude that the successor representation can serve as a weighted pointer to past memories and experiences, and may therefore be a crucial building block to include prior knowledge, and to derive context knowledge from novel input. Thus, our model provides a new tool to complement contemporary deep learning approaches on the road towards artificial general intelligence.

Flexible neural representations of abstract structural knowledge in the human Entorhinal Cortex

Generalisation of structural knowledge in the hippocampal-entorhinal system

Neural representation of abstract task structure during generalization

Abstract representations emerge in human hippocampal neurons during inference

Complementary task representations in hippocampus and prefrontal cortex for generalizing the structure of problems

A neural mechanism for compositional generalization of structure in humans

An abstract relational map emerges in the human medial prefrontal cortex with consolidation

Flexible hippocampal representation of abstract boundaries supports memory-guided choice.

Forming cognitive maps for abstract spaces: the roles of the human hippocampus and orbitofrontal cortex

Parallel cognitive maps for multiple knowledge structures in the hippocampal formation

The Tolman-Eichenbaum Machine: Unifying Space and Relational Memory through Generalization in the Hippocampal Formation

Representational similarity learning reveals a graded multidimensional semantic space in the human anterior temporal cortex

Geometry of abstract learned knowledge in the hippocampus

Task structure tailors the geometry of neural representations in human lateral prefrontal cortex

Radical flexibility of neural representation in frontoparietal cortex and the challenge of linking it to behaviour

A cellular basis for mapping behavioural structure

Neural network based formation of cognitive maps of semantic spaces and the putative emergence of abstract concepts

Recurrent Inhibitory Dynamics in the Entorhinal Cortex Support Pattern Separation

Relational integration demands are tracked by temporally delayed neural representations in alpha and beta rhythms within higher-order cortical networks

Latent representations in hippocampal network model co-evolve with behavioral exploration of task structure