Abstract:Animals rely on different decision strategies when faced with ambiguous or uncertain cues. Depending on the context, decisions may be biased towards events that were most frequently experienced in the past, or be more explorative. A particular type of decision making central to cognition is sequential memory recall in response to ambiguous cues. A previously developed spiking neuronal network implementation of sequence prediction and recall learns complex, high-order sequences in an unsupervised manner by local, biologically inspired plasticity rules. In response to an ambiguous cue, the model deterministically recalls the sequence shown most frequently during training. Here, we present an extension of the model enabling a range of different decision strategies. In this model, explorative behavior is generated by supplying neurons with noise. As the model relies on population encoding, uncorrelated noise averages out, and the recall dynamics remain effectively deterministic. In the presence of locally correlated noise, the averaging effect is avoided without impairing the model performance, and without the need for large noise amplitudes. We investigate two forms of correlated noise occurring in nature: shared synaptic background inputs, and random locking of the stimulus to spatiotemporal oscillations in the network activity. Depending on the noise characteristics, the network adopts various replay strategies. This study thereby provides potential mechanisms explaining how the statistics of learned sequences affect decision making, and how decision strategies can be adjusted after learning.

A recurrent network model of planning explains hippocampal replay and human behavior

A model of hippocampal replay driven by experience and environmental structure facilitates spatial learning

Planning behavior in a recurrent neural network that plays Sokoban

Prioritizing replay when future goals are unknown

A Robotic Model of Hippocampal Reverse Replay for Reinforcement Learning

Towards biologically plausible Dreaming and Planning in recurrent spiking networks

Learning predictive cognitive maps with spiking neurons during behavior and replays

Planning in a recurrent neural network that plays Sokoban

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

Model-Based and Model-Free Replay Mechanisms for Reinforcement Learning in Neurorobotics

Hippocampal representations emerge when training recurrent neural networks on a memory dependent maze navigation task

Distinct replay signatures for prospective decision-making and memory preservation

Replay in human visual cortex is linked to the formation of successor representations and independent of consciousness

Constructing future behaviour in the hippocampal formation through composition and replay

Prioritized Sweeping Neural DynaQ with Multiple Predecessors, and Hippocampal Replays

A Brain-Inspired Model of Hippocampal Spatial Cognition Based on a Memory-Replay Mechanism

Memory, Space, and Planning: Multiscale Predictive Representations

Intrinsic dynamics of randomly clustered networks generate place fields and preplay of novel environments

A model of how hierarchical representations constructed in the hippocampus are used to navigate through space

Consolidation of sequential experience into a deep generative network explains human memory, prediction and planning