Do place cells dream of conditional probabilities? Learning Neural Nyström representations

Mariano Tepper
DOI: https://doi.org/10.48550/arXiv.1906.01102
2019-06-06
Abstract:We posit that hippocampal place cells encode information about future locations under a transition distribution observed as an agent explores a given (physical or conceptual) space. The encoding of information about the current location, usually associated with place cells, then emerges as a necessary step to achieve this broader goal. We formally derive a biologically-inspired neural network from Nyström kernel approximations and empirically demonstrate that the network successfully approximates transition distributions. The proposed network yields representations that, just like place cells, soft-tile the input space with highly sparse and localized receptive fields. Additionally, we show that the proposed computational motif can be extended to handle supervised problems, creating class-specific place cells while exhibiting low sample complexity.
Machine Learning,Neural and Evolutionary Computing
What problem does this paper attempt to address?