Abstract:Compelling behavioral evidence suggests that humans can make optimal decisions despite the uncertainty inherent in perceptual or motor tasks. A key question in neuroscience is how populations of spiking neurons can implement such probabilistic computations. In this article, we develop a comprehensive framework for optimal, spike-based sensory integration and working memory in a dynamic environment. We propose that probability distributions are inferred spike-per-spike in recurrently connected networks of integrate-and-fire neurons. As a result, these networks can combine sensory cues optimally, track the state of a time-varying stimulus and memorize accumulated evidence over periods much longer than the time constant of single neurons. Importantly, we propose that population responses and persistent working memory states represent entire probability distributions and not only single stimulus values. These memories are reflected by sustained, asynchronous patterns of activity which make relevant information available to downstream neurons within their short time window of integration. Model neurons act as predictive encoders, only firing spikes which account for new information that has not yet been signaled. Thus, spike times signal deterministically a prediction error, contrary to rate codes in which spike times are considered to be random samples of an underlying firing rate. As a consequence of this coding scheme, a multitude of spike patterns can reliably encode the same information. This results in weakly correlated, Poisson-like spike trains that are sensitive to initial conditions but robust to even high levels of external neural noise. This spike train variability reproduces the one observed in cortical sensory spike trains, but cannot be equated to noise. On the contrary, it is a consequence of optimal spike-based inference. In contrast, we show that rate-based models perform poorly when implemented with stochastically spiking neurons.

Spiking Recurrent Neural Networks Represent Task-Relevant Neural Sequences in Rule-Dependent Computation

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

A Spiking Neural Network System for Robust Sequence Recognition

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Reinforcement Learning in Spiking Neural Networks with Stochastic and Deterministic Synapses

Training Spiking Neural Networks for Cognitive Tasks: A Versatile Framework Compatible with Various Temporal Codes.

A Tandem Learning Rule for Effective Training and Rapid Inference of Deep Spiking Neural Networks

Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

A Spike-Timing Based Integrated Model for Pattern Recognition

Precise-Spike-Driven Synaptic Plasticity: Learning Hetero-Association of Spatiotemporal Spike Patterns

Spike-based population coding and working memory

Incorporating structural plasticity into self-organization recurrent networks for sequence learning

Spiking representation learning for associative memories

A Supervised Learning Rule for Recurrent Spiking Neural Networks with Weighted Spikes.

Recurrent networks endowed with structural priors explain suboptimal animal behavior

Emergent Bio-Functional Similarities in a Cortical-Spike-Train-Decoding Spiking Neural Network Facilitate Predictions of Neural Computation

Deep Spiking Neural Network with Spike Count based Learning Rule

Flexible gating between subspaces in a neural network model of internally guided task switching