Abstract:Intrinsic dynamics within the brain can accelerate learning by providing a prior scaffolding for dynamics aligned with task objectives. Such intrinsic dynamics should self-organize and self-sustain in the face of fluctuating inputs and biological noise, including synaptic turnover and cell death. An example of such dynamics is the formation of sequences, a ubiquitous motif in neural activity. The sequence-generating circuit in zebra finch HVC provides a reliable timing scaffold for motor output in song and demonstrates a remarkable capacity for unsupervised recovery following perturbation. Inspired by HVC, we seek a local plasticity rule capable of organizing and maintaining sequence-generating dynamics despite continual network perturbations. We adopt a meta-learning approach introduced by Confavreux et al, which parameterizes a learning rule using basis functions constructed from pre- and postsynaptic activity and synapse size, with tunable time constants. Candidate rules are simulated within initially random networks, and their fitness is evaluated according to a loss function that measures the fidelity with which the resulting dynamics encode time. We use this approach to introduce biological noise, forcing meta-learning to find robust solutions. We first show that, in the absence of perturbation, meta-learning identifies a temporally asymmetric generalization of Oja’s rule that reliably organizes sparse sequential activity. When synaptic turnover is introduced, the learned rule incorporates an additional form of homeostasis, better maintaining sequential dynamics relative to other previously proposed rules. Additionally, inspired by recent findings demonstrating plasticity in synapses from inhibitory interneurons in HVC, we explore the role of inhibitory plasticity in sequence-generating circuits. We find that learned plasticity adjusts both excitation and inhibition in response to manipulations, outperforming rules applied only to excitatory connections. We demonstrate how plasticity acting on both excitatory and inhibitory synapses can better shape excitatory cell dynamics to scaffold timing representations.

Networks that learn the precise timing of event sequences

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

Learning spatiotemporal signals using a recurrent spiking network that discretizes time

Temporal sequence learning in winner-take-all networks of spiking neurons demonstrated in a brain-based device

Different Propagation Speeds of Recalled Sequences in Plastic Spiking Neural Networks

Sequence learning, prediction, and replay in networks of spiking neurons

Recall tempo of Hebbian sequences depends on the interplay of Hebbian kernel with tutor signal timing

Stimulus-Driven and Spontaneous Dynamics in Excitatory-Inhibitory Recurrent Neural Networks for Sequence Representation

Magnetic Resonance Force Microscopy Measurement of Entangled Spin States

Predictive learning rules generate a cortical-like replay of probabilistic sensory experiences

A Spike-Timing Based Integrated Model for Pattern Recognition

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Discovering plasticity rules that organize and maintain neural circuits

Sequential Memory: a Putative Neural and Synaptic Dynamical Mechanism.

Precise-Spike-Driven Synaptic Plasticity: Learning Hetero-Association of Spatiotemporal Spike Patterns

Synaptic basis of a sub-second representation of time in a neural circuit model

ELiSe: Efficient Learning of Sequences in Structured Recurrent Networks

Spatial representation of temporal information through spike timing dependent plasticity

Cell assembly sequences arising from spike threshold adaptation keep track of time in the hippocampus

Recurrent Network Models Of Sequence Generation And Memory

Dynamic control of sequential retrieval speed in networks with heterogeneous learning rules