Abstract:Compelling behavioral evidence suggests that humans can make optimal decisions despite the uncertainty inherent in perceptual or motor tasks. A key question in neuroscience is how populations of spiking neurons can implement such probabilistic computations. In this article, we develop a comprehensive framework for optimal, spike-based sensory integration and working memory in a dynamic environment. We propose that probability distributions are inferred spike-per-spike in recurrently connected networks of integrate-and-fire neurons. As a result, these networks can combine sensory cues optimally, track the state of a time-varying stimulus and memorize accumulated evidence over periods much longer than the time constant of single neurons. Importantly, we propose that population responses and persistent working memory states represent entire probability distributions and not only single stimulus values. These memories are reflected by sustained, asynchronous patterns of activity which make relevant information available to downstream neurons within their short time window of integration. Model neurons act as predictive encoders, only firing spikes which account for new information that has not yet been signaled. Thus, spike times signal deterministically a prediction error, contrary to rate codes in which spike times are considered to be random samples of an underlying firing rate. As a consequence of this coding scheme, a multitude of spike patterns can reliably encode the same information. This results in weakly correlated, Poisson-like spike trains that are sensitive to initial conditions but robust to even high levels of external neural noise. This spike train variability reproduces the one observed in cortical sensory spike trains, but cannot be equated to noise. On the contrary, it is a consequence of optimal spike-based inference. In contrast, we show that rate-based models perform poorly when implemented with stochastically spiking neurons.

Ensemble perspective for understanding temporal credit assignment

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Learning spatiotemporal signals using a recurrent spiking network that discretizes time

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

A Spiking Neural Network System for Robust Sequence Recognition

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding.

STCA: Spatio-Temporal Credit Assignment with Delayed Feedback in Deep Spiking Neural Networks

Attention-Based Deep Spiking Neural Networks for Temporal Credit Assignment Problems.

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Temporal Coding in Recurrent Spiking Neural Networks with Synaptic Delay-Weight Plasticity

Incorporating structural plasticity into self-organization recurrent networks for sequence learning

Structural Credit Assignment with Coordinated Exploration

Decoding Spiking Mechanism with Dynamic Learning on Neuron Population

Meta predictive learning model of languages in neural circuits

Spike-based population coding and working memory

Temporal sequence learning in winner-take-all networks of spiking neurons demonstrated in a brain-based device

Different eigenvalue distributions encode the same temporal tasks in recurrent neural networks

Spiking representation learning for associative memories

Spiking neurons can discover predictive features by aggregate-label learning