Abstract:Intrinsic dynamics within the brain can accelerate learning by providing a prior scaffolding for dynamics aligned with task objectives. Such intrinsic dynamics should self-organize and self-sustain in the face of fluctuating inputs and biological noise, including synaptic turnover and cell death. An example of such dynamics is the formation of sequences, a ubiquitous motif in neural activity. The sequence-generating circuit in zebra finch HVC provides a reliable timing scaffold for motor output in song and demonstrates a remarkable capacity for unsupervised recovery following perturbation. Inspired by HVC, we seek a local plasticity rule capable of organizing and maintaining sequence-generating dynamics despite continual network perturbations. We adopt a meta-learning approach introduced by Confavreux et al, which parameterizes a learning rule using basis functions constructed from pre- and postsynaptic activity and synapse size, with tunable time constants. Candidate rules are simulated within initially random networks, and their fitness is evaluated according to a loss function that measures the fidelity with which the resulting dynamics encode time. We use this approach to introduce biological noise, forcing meta-learning to find robust solutions. We first show that, in the absence of perturbation, meta-learning identifies a temporally asymmetric generalization of Oja’s rule that reliably organizes sparse sequential activity. When synaptic turnover is introduced, the learned rule incorporates an additional form of homeostasis, better maintaining sequential dynamics relative to other previously proposed rules. Additionally, inspired by recent findings demonstrating plasticity in synapses from inhibitory interneurons in HVC, we explore the role of inhibitory plasticity in sequence-generating circuits. We find that learned plasticity adjusts both excitation and inhibition in response to manipulations, outperforming rules applied only to excitatory connections. We demonstrate how plasticity acting on both excitatory and inhibitory synapses can better shape excitatory cell dynamics to scaffold timing representations.

Computational Modeling of Neural Plasticity for Self-Organization of Neural Networks

Self-organization of microcircuits in networks of neurons with plastic synapses

Computational Modeling of Spiking Neural Network with Learning Rules from STDP and Intrinsic Plasticity

Incorporating structural plasticity into self-organization recurrent networks for sequence learning

Learning the Plasticity: Plasticity-Driven Learning Framework in Spiking Neural Networks

A theoretical framework for learning through structural plasticity

Computational models of learning and synaptic plasticity

How the Brain Formulates Memory: A Spatio-Temporal Model Research Frontier.

Computational Modeling of Neuronal Networks

Learning Structure of Complex Sensory Inputs with Plasticity in Neural Microcircuits

Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits

Biological Modelling of a Computational Spiking Neural Network with Neuronal Avalanches.

A Unified Computational Model of the Genetic Regulatory Networks Underlying Synaptic, Intrinsic and Homeostatic Plasticity

Critical neural networks with short and long term plasticity

Explaining neuroplasticity using equivalent circuits: A mechanistic perspective

Assemblies, synapse clustering and network topology interact with plasticity to explain structure-function relationships of the cortical connectome

Evolving Self-Assembling Neural Networks: From Spontaneous Activity to Experience-Dependent Learning

Self-organization of multi-layer spiking neural networks

Memory-Dependent Computation and Learning in Spiking Neural Networks Through Hebbian Plasticity

Self-Organization Of A Neural Network With Heterogeneous Neurons Enhances Coherence And Stochastic Resonance

Discovering plasticity rules that organize and maintain neural circuits