Abstract:Compelling behavioral evidence suggests that humans can make optimal decisions despite the uncertainty inherent in perceptual or motor tasks. A key question in neuroscience is how populations of spiking neurons can implement such probabilistic computations. In this article, we develop a comprehensive framework for optimal, spike-based sensory integration and working memory in a dynamic environment. We propose that probability distributions are inferred spike-per-spike in recurrently connected networks of integrate-and-fire neurons. As a result, these networks can combine sensory cues optimally, track the state of a time-varying stimulus and memorize accumulated evidence over periods much longer than the time constant of single neurons. Importantly, we propose that population responses and persistent working memory states represent entire probability distributions and not only single stimulus values. These memories are reflected by sustained, asynchronous patterns of activity which make relevant information available to downstream neurons within their short time window of integration. Model neurons act as predictive encoders, only firing spikes which account for new information that has not yet been signaled. Thus, spike times signal deterministically a prediction error, contrary to rate codes in which spike times are considered to be random samples of an underlying firing rate. As a consequence of this coding scheme, a multitude of spike patterns can reliably encode the same information. This results in weakly correlated, Poisson-like spike trains that are sensitive to initial conditions but robust to even high levels of external neural noise. This spike train variability reproduces the one observed in cortical sensory spike trains, but cannot be equated to noise. On the contrary, it is a consequence of optimal spike-based inference. In contrast, we show that rate-based models perform poorly when implemented with stochastically spiking neurons.

Rate-distortion theory of neural coding and its implications for working memory

Population Rate Coding in Recurrent Neuronal Networks with Unreliable Synapses

Exploring Action-Centric Representations Through the Lens of Rate-Distortion Theory

Network mechanisms of working memory: the role of neuronal nonlinearities

The geometry of efficient codes: how rate-distortion trade-offs distort the latent representations of generative models

Rate-Distortion Theory in Coding for Machines and its Application

Distinct Subthreshold Mechanisms Underlying Rate-Coding Principles in Primate Auditory Cortex.

Rate-distortion Bound for a Class of Non-Gaussian Sources with Memory

Intermittent rate coding and cue-specific ensembles support working memory

Spike-based population coding and working memory

Population rate codes carried by mean, fluctuation and synchrony of neuronal firings

Energy Coding in Biological Neural Networks

Neural population dynamics of human working memory

Population Coding and Decoding in a Neural Field: A Computational Study

Population rate coding in recurrent neuronal networks with undetermined-type neurons

Neural stochastic codes, encoding and decoding

Population coding in mouse visual cortex: response reliability and dissociability of stimulus tuning and noise correlation

The computational foundations of dynamic coding in working memory

Psychophysical scaling reveals a unified theory of visual memory strength

Neurocomputational models of working memory

Optimizing working memory with heterogeneity of recurrent cortical excitation