Abstract:Compelling behavioral evidence suggests that humans can make optimal decisions despite the uncertainty inherent in perceptual or motor tasks. A key question in neuroscience is how populations of spiking neurons can implement such probabilistic computations. In this article, we develop a comprehensive framework for optimal, spike-based sensory integration and working memory in a dynamic environment. We propose that probability distributions are inferred spike-per-spike in recurrently connected networks of integrate-and-fire neurons. As a result, these networks can combine sensory cues optimally, track the state of a time-varying stimulus and memorize accumulated evidence over periods much longer than the time constant of single neurons. Importantly, we propose that population responses and persistent working memory states represent entire probability distributions and not only single stimulus values. These memories are reflected by sustained, asynchronous patterns of activity which make relevant information available to downstream neurons within their short time window of integration. Model neurons act as predictive encoders, only firing spikes which account for new information that has not yet been signaled. Thus, spike times signal deterministically a prediction error, contrary to rate codes in which spike times are considered to be random samples of an underlying firing rate. As a consequence of this coding scheme, a multitude of spike patterns can reliably encode the same information. This results in weakly correlated, Poisson-like spike trains that are sensitive to initial conditions but robust to even high levels of external neural noise. This spike train variability reproduces the one observed in cortical sensory spike trains, but cannot be equated to noise. On the contrary, it is a consequence of optimal spike-based inference. In contrast, we show that rate-based models perform poorly when implemented with stochastically spiking neurons.

Extending dynamic memory of spiking neuron networks

Short-Term Memory Through Persistent Activity: Evolution of Self-Stopping and Self-Sustaining Activity in Spiking Neural Networks

How the Brain Formulates Memory: A Spatio-Temporal Model Research Frontier.

A Spike-Timing Pattern Based Neural Network Model for the Study of Memory Dynamics

Situation-Based Neuromorphic Memory in Spiking Neuron-Astrocyte Network

Situation-based memory in spiking neuron-astrocyte network

Volatile Memory Motifs: Minimal Spiking Neural Networks

Memory-efficient neurons and synapses for spike-timing-dependent-plasticity in large-scale spiking networks

A neuronal dynamics study on a neuromorphic chip

Computing of temporal information in spiking neural networks with ReRAM synapses

Fast learning without synaptic plasticity in spiking neural networks

Optimality of short-term synaptic plasticity in modelling certain dynamic environments

A system of interacting neurons with short term synaptic facilitation

Active Dendrites Enable Robust Spiking Computations despite Timing Jitter

Spike-based population coding and working memory

Long-term memory stabilized by noise-induced rehearsal

Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics

Collective dynamics and long-range order in thermal neuristor networks

Co-existence of synaptic plasticity and metastable dynamics in a spiking model of cortical circuits

Self-sustained Activity of Low Firing Rate in Balanced Networks

Prominent characteristics of recurrent neuronal networks are robust against low synaptic weight resolution