Abstract:An increasing body of evidence suggests that the trial-to-trial variability of spiking activity in the brain is not mere noise, but rather the reflection of a sampling-based encoding scheme for probabilistic computing. Since the precise statistical properties of neural activity are important in this context, many models assume an ad-hoc source of well-behaved, explicit noise, either on the input or on the output side of single neuron dynamics, most often assuming an independent Poisson process in either case. However, these assumptions are somewhat problematic: neighboring neurons tend to share receptive fields, rendering both their input and their output correlated; at the same time, neurons are known to behave largely deterministically, as a function of their membrane potential and conductance. We suggest that spiking neural networks may, in fact, have no need for noise to perform sampling-based Bayesian inference. We study analytically the effect of auto- and cross-correlations in functionally Bayesian spiking networks and demonstrate how their effect translates to synaptic interaction strengths, rendering them controllable through synaptic plasticity. This allows even small ensembles of interconnected deterministic spiking networks to simultaneously and co-dependently shape their output activity through learning, enabling them to perform complex Bayesian computation without any need for noise, which we demonstrate in silico, both in classical simulation and in neuromorphic emulation. These results close a gap between the abstract models and the biology of functionally Bayesian spiking networks, effectively reducing the architectural constraints imposed on physical neural substrates required to perform probabilistic computing, be they biological or artificial.

Stochastic neurodynamical computation of brain functions

Stochastic Dynamics As a Principle of Brain Function.

Stochastic Dynamics in the Brain and Probabilistic Decision-Making

Stochasticity from function -- why the Bayesian brain may need no noise

Functional importance of noise in neuronal information processing

Cortical attractor dynamics and connectivity, stochasticity, psychiatric disorders, and aging

Sub-threshold neuronal activity and the dynamical regime of cerebral cortex

Application and Computation of Probabilistic Neural Plasticity

Co-operativity in neurons and the role of noise in brain

Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations

Stochastic cellular automata model of neural networks

Dynamics of stochastic integrate-and-fire networks

Non-normality, reactivity, and intrinsic stochasticity in neural dynamics: a non-equilibrium potential approach

Unveiling the intrinsic dynamics of biological and artificial neural networks: from criticality to optimal representations

Toward stochastic neural computing

Neural networks with dynamical synapses: from mixed-mode oscillations and spindles to chaos

Dynamics of Firing Patterns, Synchronization and Resonances in Neuronal Electrical Activities: Experiments and Analysis

Noise in Attractor Networks in the Brain Produced by Graded Firing Rate Representations

Clinical Applications of Stochastic Dynamic Models of the Brain, Part II: A Review

A decision-making Fokker-Planck model in computational neuroscience

Alternation of up and down states at a dynamical phase-transition of a neural network with spatiotemporal attractors