Abstract:Transferring latent structure from one environment or problem to another is a mechanism by which humans and animals generalize with very little data. Inspired by cognitive and neurobiological insights, we propose graph schemas as a mechanism of abstraction for transfer learning. Graph schemas start with latent graph learning where perceptually aliased observations are disambiguated in the latent space using contextual information. Latent graph learning is also emerging as a new computational model of the hippocampus to explain map learning and transitive inference. Our insight is that a latent graph can be treated as a flexible template -- a schema -- that models concepts and behaviors, with slots that bind groups of latent nodes to the specific observations or groundings. By treating learned latent graphs (schemas) as prior knowledge, new environments can be quickly learned as compositions of schemas and their newly learned bindings. We evaluate graph schemas on two previously published challenging tasks: the memory & planning game and one-shot StreetLearn, which are designed to test rapid task solving in novel environments. Graph schemas can be learned in far fewer episodes than previous baselines, and can model and plan in a few steps in novel variations of these tasks. We also demonstrate learning, matching, and reusing graph schemas in more challenging 2D and 3D environments with extensive perceptual aliasing and size variations, and show how different schemas can be composed to model larger and more complex environments. To summarize, our main contribution is a unified system, inspired and grounded in cognitive science, that facilitates rapid transfer learning of new environments using schemas via map-induction and composition that handles perceptual aliasing.

Humans can navigate complex graph structures acquired during latent learning

Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph

Human learning of hierarchical graphs

Graph schemas as abstractions for transfer learning, inference, and planning

Time-resolved functional connectivity during visuomotor graph learning

Learning and reasoning with graph data

Reasoning Like Human: Hierarchical Reinforcement Learning for Knowledge Graph Reasoning

A neural mechanism for compositional generalization of structure in humans

Graph learning-based generation of abstractions for reinforcement learning

Learning Dynamics and Structure of Complex Systems Using Graph Neural Networks

An abstract relational map emerges in the human medial prefrontal cortex with consolidation

Neurosymbolic AI for Reasoning on Graph Structures: A Survey

Compressed higher-order structures facilitate human knowledge network learning

Humanoid infers Archimedes' principle: understanding physical relations and object affordances through cumulative learning experiences

Learning abstract structure for drawing by efficient motor program induction

Abstract representations emerge in human hippocampal neurons during inference

Learning Algebraic Representation for Abstract Spatial-Temporal Reasoning

Intrinsically motivated graph exploration using network theories of human curiosity

Introducing Expertise Logic into Graph Representation Learning from A Causal Perspective

Structuring Knowledge with Cognitive Maps and Cognitive Graphs