Abstract:Theoretical models of neuronal function consider different mechanisms through which networks learn, classify and discern inputs. A central focus of these models is to understand how associations are established amongst neurons, in order to predict spiking patterns that are compatible with empirical observations. Although these models have led to major insights and advances, they still do not account for the astonishing velocity with which the brain solves certain problems and what lies behind its creativity, amongst others features. We examine two important components that may crucially aid comprehensive understanding of said neurodynamical processes. First, we argue that once presented with a problem, different putative solutions are generated in parallel by different groups or local neuronal complexes, with the subsequent stabilization and spread of the best solutions. Using mathematical models we show that this mechanism accelerates finding the right solutions. This formalism is analogous to standard replicator-mutator models of evolution where mutation is analogous to the probability of neuron state switching (on/off). The second factor that we incorporate is structural synaptic plasticity, i.e. the making of new and disbanding of old synapses, which we apply as a dynamical reorganization of synaptic connections. We show that Hebbian learning alone does not suffice to reach optimal solutions. However, combining it with parallel evaluation and structural plasticity opens up possibilities for efficient problem solving. In the resulting networks, topologies converge to subsets of fully connected components. Imposing costs on synapses reduces the connectivity, although the number of connected components remains robust. The average lifetime of synapses is longer for connections that are established early, and diminishes with synaptic cost.

Strong anti-Hebbian plasticity alters the convexity of network attractor landscapes

Evolving Decomposed Plasticity Rules for Information-Bottlenecked Meta-Learning

Synergies Between Intrinsic and Synaptic Plasticity Based on Information Theoretic Learning

Unsupervised learning by a nonlinear network with Hebbian excitatory and anti-Hebbian inhibitory neurons

Memorizing morph patterns in small-world neuronal network

Nontrivial Global Attractors in 2-D Multistable Attractor Neural Networks

A Mathematical Analysis of the Effects of Hebbian Learning Rules on the Dynamics and Structure of Discrete-Time Random Recurrent Neural Networks

Using local plasticity rules to train recurrent neural networks

Stable Hebbian Learning from Spike Timing-Dependent Plasticity

Cooperation of Spike Timing-Dependent and Heterosynaptic Plasticities in Neural Networks: A Fokker-Planck Approach

Competitive Hebbian learning through spike-timing-dependent synaptic plasticity

Dynamic Properties and a New Learning Mechanism in Higher Order Neural Networks

Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

Strong Allee Effect Synaptic Plasticity Rule in an Unsupervised Learning Environment

Modeling and Contractivity of Neural-Synaptic Networks with Hebbian Learning

A novel stochastic Hebb-like learning rule for neural networks

Anti-Hebbian learning in topologically constrained linear networks: a tutorial

Balancing complexity, performance and plausibility to meta learn plasticity rules in recurrent spiking networks.

Coupled Hebbian learning and evolutionary dynamics in a formal model for structural synaptic plasticity

Neuron-centric Hebbian Learning

Synaptic plasticity alters the nature of chaos transition in neural networks