Abstract:Cortical neurons are versatile and efficient coding units that develop strong preferences for specific stimulus characteristics. The sharpness of tuning and coding efficiency is hypothesized to be controlled by delicately balanced excitation and inhibition. These observations suggest a need for detailed co-tuning of excitatory and inhibitory populations. Theoretical studies have demonstrated that a combination of plasticity rules can lead to the emergence of excitation/inhibition (E/I) co-tuning in neurons driven by independent, low-noise signals. However, cortical signals are typically noisy and originate from highly recurrent networks, generating correlations in the inputs. This raises questions about the ability of plasticity mechanisms to self-organize co-tuned connectivity in neurons receiving noisy, correlated inputs. Here, we study the emergence of input selectivity and weight co-tuning in a neuron receiving input from a recurrent network via plastic feedforward connections. We demonstrate that while strong noise levels destroy the emergence of co-tuning in the readout neuron, introducing specific structures in the non-plastic pre-synaptic connectivity can re-establish it by generating a favourable correlation structure in the population activity. We further show that structured recurrent connectivity can impact the statistics in fully plastic recurrent networks, driving the formation of co-tuning in neurons that do not receive direct input from other areas. Our findings indicate that the network dynamics created by simple, biologically plausible structural connectivity patterns can enhance the ability of synaptic plasticity to learn input-output relationships in higher brain areas. Many studies of learning in biological neural networks have focused on how plausible plasticity rules shape individual connections between neurons in a recurrent network or in feed-forward projections. However, in the latter case, the presynaptic network properties, such as clustered connectivity, strongly influence population dynamics and, thus, the learning process of the projections. Here, we aim to close this gap by showing how non-plastic network structure can strongly influence the outcomes of synaptic learning. We show that unstructured recurrent connectivity and the presence of noise can significantly reduce the ability of synaptic plasticity to separate presynaptic input populations and coordinate excitatory and inhibitory connection development, while the introduction of overlapping clustered structures in fixed or plastic recurrent connectivity can boost synaptic learning. Using Bayesian inference, we identify the optimal connectivity structures for a recurrent network and demonstrate the strong effects that relatively simple connectivity patterns can have on the ability of a network to learn via local plasticity.

Evolving Local Plasticity Rules for Synergistic Learning in Echo State Networks.

Synergies Between Synaptic and Intrinsic Plasticity in Echo State Networks.

Echo state networks regulated by local intrinsic plasticity rules for regression

Computational Modeling of Structural Synaptic Plasticity in Echo State Networks.

Modeling Neural Plasticity in Echo State Networks for Classification and Regression

Evolving Dual-Threshold Bienenstock-Cooper-Munro Learning Rules in Echo State Networks

Balancing complexity, performance and plausibility to meta learn plasticity rules in recurrent spiking networks.

Adaptive Deep Spiking Neural Network with Global-Local Learning Via Balanced Excitatory and Inhibitory Mechanism

Modeling Neural Plasticity in Echo State Networks for Time Series Prediction

EchoSpike Predictive Plasticity: An Online Local Learning Rule for Spiking Neural Networks

Synergies Between Intrinsic and Synaptic Plasticity Based on Information Theoretic Learning

Using local plasticity rules to train recurrent neural networks

Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

Evolving interpretable plasticity for spiking networks

Ensemble and Pre-Training Approach for Echo State Network and Extreme Learning Machine Models

Precise-Spike-Driven Synaptic Plasticity: Learning Hetero-Association of Spatiotemporal Spike Patterns

Evolving Generalized Modulatory Learning: Unifying Neuromodulation and Synaptic Plasticity

Adaptive structure evolution and biologically plausible synaptic plasticity for recurrent spiking neural networks

Learning Structure of Complex Sensory Inputs with Plasticity in Neural Microcircuits

Unveiling the role of plasticity rules in reservoir computing

Structural influences on synaptic plasticity: The role of presynaptic connectivity in the emergence of E/I co-tuning