Abstract:Deep neural networks have made tremendous gains in emulating human-like intelligence, and have been used increasingly as ways of understanding how the brain may solve the complex computational problems on which this relies. However, these still fall short of, and therefore fail to provide insight into how the brain supports strong forms of generalization of which humans are capable. One such case is out-of-distribution (OOD) generalization-successful performance on test examples that lie outside the distribution of the training set. Here, we identify properties of processing in the brain that may contribute to this ability. We describe a two-part algorithm that draws on specific features of neural computation to achieve OOD generalization, and provide a proof of concept by evaluating performance on two challenging cognitive tasks. First we draw on the fact that the mammalian brain represents metric spaces using grid cell code (e.g., in the entorhinal cortex): abstract representations of relational structure, organized in recurring motifs that cover the representational space. Second, we propose an attentional mechanism that operates over the grid cell code using Determinantal Point Process (DPP), that we call DPP attention (DPP-A) -- a transformation that ensures maximum sparseness in the coverage of that space. We show that a loss function that combines standard task-optimized error with DPP-A can exploit the recurring motifs in the grid cell code, and can be integrated with common architectures to achieve strong OOD generalization performance on analogy and arithmetic tasks. This provides both an interpretation of how the grid cell code in the mammalian brain may contribute to generalization performance, and at the same time a potential means for improving such capabilities in artificial neural networks.

Prediction and Generalisation over Directed Actions by Grid Cells

Actionable Neural Representations: Grid Cells from Minimal Constraints

Grid Cell Path Integration For Movement-Based Visual Object Recognition

Grid Cell Modeling with Mapping Representation of Self-Motion for Path Integration

Do grid codes afford generalization and flexible decision-making?

Flow-guided Motion Prediction with Semantics and Dynamic Occupancy Grid Maps

Bayesian Integration of Multi-resolutional Grid Codes for Spatial Cognition

Learning grid cells by predictive coding

Determinantal Point Process Attention Over Grid Cell Code Supports Out of Distribution Generalization

Grid-SD2E: A General Grid-Feedback in a System for Cognitive Learning

Interpretable Deep Feature Propagation for Early Action Recognition

Model Learning Based on Grid Cell Representations

Grid cells and their potential application in AI

Emergence of grid-like representations by training recurrent neural networks to perform spatial localization

Prediction-for-CompAction: navigation in social environments using generalized cognitive maps

Active Predictive Coding: A Unified Neural Framework for Learning Hierarchical World Models for Perception and Planning

Scene Compliant Trajectory Forecast With Agent-Centric Spatio-Temporal Grids

Local prediction-learning in high-dimensional spaces enables neural networks to plan

Generalized Cell Mapping Method with Deep Learning for Global Analysis and Response Prediction of Dynamical Systems.

The WayHome: Long-term Motion Prediction on Dynamically Scaled

Brain Inspired Probabilistic Occupancy Grid Mapping with Hyperdimensional Computing