Abstract:Brain's connectivity reveals modular and hierarchical structures at various scales. This organization is typically believed to support the coexistence of segregation (specialization) and integration (binding) of information. Motivated by developmental processes, some authors have studied the self-organization of neural networks into modular hierarchies mediated by adaptive mechanism under spontaneous neural activity. Following evidence that the sensory cortices organize into assemblies under selective stimuli, other authors have shown that stable neural assemblies can emerge in random neural networks due to targeted stimulation, embedding various forms of synaptic plasticity in presence of homeostatic and/or control mechanisms. Here, we show that simple spike-timing-dependent plasticity (STDP) rules, based only on pre- and post-synaptic spike times, can also lead to the stable encoding of memories in the absence of any control mechanism. We develop a model of spiking neurons, trained to stimuli targeting different sub-populations. The model is intended to satisfy biologically plausible features: (i) it contains excitatory and inhibitory neurons with Hebbian and anti-Hebbian STDP; (ii) neither the neuronal activity nor the synaptic weights are frozen after the learning phase. Instead, the neurons are allowed to fire spontaneously while synaptic plasticity remains active. We find that only the combination of two inhibitory STDP sub-populations allows for the formation of stable modular organization in the network, with each sub-population playing a distinctive role. The Hebbian sub-population controls for the firing activity, while the anti-Hebbian one promotes pattern selectivity. After the learning phase, the network settles into an asynchronous irregular resting-state. This post-learning activity is associated with spontaneous memory recalls, which turn fundamental for the long-term consolidation of the learned memories. Due to its simplicity, the model, here introduced, can represent a test-bed for further investigations on the role played by STDP on memory storing and maintenance.

A Mathematical Analysis of the Effects of Hebbian Learning Rules on the Dynamics and Structure of Discrete-Time Random Recurrent Neural Networks

Theory of coupled neuronal-synaptic dynamics

Modeling and Contractivity of Neural-Synaptic Networks with Hebbian Learning

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

Learning and Structure of Neuronal Networks

Coupled Hebbian learning and evolutionary dynamics in a formal model for structural synaptic plasticity

Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

Learning in Associative Networks through Pavlovian Dynamics

Connectivity structure and dynamics of nonlinear recurrent neural networks

Logarithmic distributions prove that intrinsic learning is Hebbian

Learning cortical hierarchies with temporal Hebbian updates

Latching dynamics in neural networks with synaptic depression

Emergence and maintenance of modularity in neural networks with Hebbian and anti-Hebbian inhibitory STDP

Using local plasticity rules to train recurrent neural networks

Hebbian Learning from First Principles

Statistical physics of learning in high-dimensional chaotic systems

One Step Back, Two Steps Forward: Interference and Learning in Recurrent Neural Networks

Neural networks with transient state dynamics

Temporally Asymmetric Hebbian Learning and Neuronal Response Variability

Learning recurrent dynamics in spiking networks