Abstract:Even in the absence of sensory stimulation the brain is spontaneously active. This background "noise" seems to be the dominant cause of the notoriously high trial-to-trial variability of neural recordings. Recent experimental observations have extended our knowledge of trial-to-trial variability and spontaneous activity in several directions: 1. Trial-to-trial variability systematically decreases following the onset of a sensory stimulus or the start of a motor act. 2. Spontaneous activity states in sensory cortex outline the region of evoked sensory responses. 3. Across development, spontaneous activity aligns itself with typical evoked activity patterns. 4. The spontaneous brain activity prior to the presentation of an ambiguous stimulus predicts how the stimulus will be interpreted. At present it is unclear how these observations relate to each other and how they arise in cortical circuits. Here we demonstrate that all of these phenomena can be accounted for by a deterministic self-organizing recurrent neural network model (SORN), which learns a predictive model of its sensory environment. The SORN comprises recurrently coupled populations of excitatory and inhibitory threshold units and learns via a combination of spike-timing dependent plasticity (STDP) and homeostatic plasticity mechanisms. Similar to balanced network architectures, units in the network show irregular activity and variable responses to inputs. Additionally, however, the SORN exhibits sequence learning abilities matching recent findings from visual cortex and the network's spontaneous activity reproduces the experimental findings mentioned above. Intriguingly, the network's behaviour is reminiscent of sampling-based probabilistic inference, suggesting that correlates of sampling-based inference can develop from the interaction of STDP and homeostasis in deterministic networks. We conclude that key observations on spontaneous brain activity and the variability of neural responses can be accounted for by a simple deterministic recurrent neural network which learns a predictive model of its sensory environment via a combination of generic neural plasticity mechanisms.

Embedding stochastic dynamics of the environment in spontaneous activity by prediction-based plasticity

Predictive learning rules generate a cortical-like replay of probabilistic sensory experiences

Learning predictive cognitive maps with spiking neurons during behavior and replays

Discovering plasticity rules that organize and maintain neural circuits

Balancing complexity, performance and plausibility to meta learn plasticity rules in recurrent spiking networks.

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

Evolving interpretable plasticity for spiking networks

Spatial representation of temporal information through spike timing dependent plasticity

Co-existence of synaptic plasticity and metastable dynamics in a spiking model of cortical circuits

Optimality of short-term synaptic plasticity in modelling certain dynamic environments

Robustness of STDP to Spike Timing Jitter.

Fluctuation-driven plasticity allows for flexible rewiring of neuronal assemblies

Self-organization of microcircuits in networks of neurons with plastic synapses

Using local plasticity rules to train recurrent neural networks

Where’s the Noise? Key Features of Spontaneous Activity and Neural Variability Arise through Learning in a Deterministic Network

Environmental variability and network structure determine the optimal plasticity mechanisms in embodied agents

Inhibitory plasticity supports replay generalization in the hippocampus

Learning spatiotemporal signals using a recurrent spiking network that discretizes time

Refinement and Pattern Formation in Neural Circuits by the Interaction of Traveling Waves with Spike-Timing Dependent Plasticity

Incorporating structural plasticity into self-organization recurrent networks for sequence learning

Intrinsic dynamics of randomly clustered networks generate place fields and preplay of novel environments