Abstract:Intrinsic dynamics within the brain can accelerate learning by providing a prior scaffolding for dynamics aligned with task objectives. Such intrinsic dynamics should self-organize and self-sustain in the face of fluctuating inputs and biological noise, including synaptic turnover and cell death. An example of such dynamics is the formation of sequences, a ubiquitous motif in neural activity. The sequence-generating circuit in zebra finch HVC provides a reliable timing scaffold for motor output in song and demonstrates a remarkable capacity for unsupervised recovery following perturbation. Inspired by HVC, we seek a local plasticity rule capable of organizing and maintaining sequence-generating dynamics despite continual network perturbations. We adopt a meta-learning approach introduced by Confavreux et al, which parameterizes a learning rule using basis functions constructed from pre- and postsynaptic activity and synapse size, with tunable time constants. Candidate rules are simulated within initially random networks, and their fitness is evaluated according to a loss function that measures the fidelity with which the resulting dynamics encode time. We use this approach to introduce biological noise, forcing meta-learning to find robust solutions. We first show that, in the absence of perturbation, meta-learning identifies a temporally asymmetric generalization of Oja’s rule that reliably organizes sparse sequential activity. When synaptic turnover is introduced, the learned rule incorporates an additional form of homeostasis, better maintaining sequential dynamics relative to other previously proposed rules. Additionally, inspired by recent findings demonstrating plasticity in synapses from inhibitory interneurons in HVC, we explore the role of inhibitory plasticity in sequence-generating circuits. We find that learned plasticity adjusts both excitation and inhibition in response to manipulations, outperforming rules applied only to excitatory connections. We demonstrate how plasticity acting on both excitatory and inhibitory synapses can better shape excitatory cell dynamics to scaffold timing representations.

Control of synaptic plasticity via the fusion of reinforcement learning and unsupervised learning in neural networks

Control of synaptic plasticity in neural networks

Reinforcement Learning in Spiking Neural Networks with Stochastic and Deterministic Synapses

Model Based Inference of Synaptic Plasticity Rules

Cortical credit assignment by Hebbian, neuromodulatory and inhibitory plasticity

The brain as an efficient and robust adaptive learner

Synergies Between Intrinsic and Synaptic Plasticity Based on Information Theoretic Learning

Control of synaptic plasticity in deep cortical networks

Fast and slow synaptic plasticity enables concurrent control and learning

Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

Dis-inhibitory neuronal circuits can control the sign of synaptic plasticity

Biologically plausible local synaptic learning rules robustly implement deep supervised learning

Balancing complexity, performance and plausibility to meta learn plasticity rules in recurrent spiking networks.

Using local plasticity rules to train recurrent neural networks

Computational models of learning and synaptic plasticity

Synaptic Model of Learning and Memory:Long-Term Synaptic Plasticity

Inferring neural activity before plasticity as a foundation for learning beyond backpropagation

The Calcitron: A Simple Neuron Model That Implements Many Learning Rules via the Calcium Control Hypothesis

Discovering plasticity rules that organize and maintain neural circuits

A Study of Biologically Plausible Neural Network: The Role and Interactions of Brain-Inspired Mechanisms in Continual Learning

Unsupervised representation learning with Hebbian synaptic and structural plasticity in brain-like feedforward neural networks