Abstract:In neural circuits, synaptic strengths influence neuronal activity by shaping network dynamics, and neuronal activity influences synaptic strengths through activity-dependent plasticity. Motivated by this fact, we study a recurrent-network model in which neuronal units and synaptic couplings are interacting dynamic variables, with couplings subject to Hebbian modification with decay around quenched random strengths. Rather than assigning a specific role to the plasticity, we use dynamical mean-field theory and other techniques to systematically characterize the neuronal-synaptic dynamics, revealing a rich phase diagram. Adding Hebbian plasticity slows activity in already chaotic networks and can induce chaos in otherwise quiescent networks. Anti-Hebbian plasticity quickens activity and produces an oscillatory component. Analysis of the Jacobian shows that Hebbian and anti-Hebbian plasticity push locally unstable modes toward the real and imaginary axes, respectively, explaining these behaviors. Both random-matrix and Lyapunov analysis show that strong Hebbian plasticity segregates network timescales into two bands, with a slow, synapse-dominated band driving the dynamics, suggesting a flipped view of the network as synapses connected by neurons. For increasing strength, Hebbian plasticity initially raises the complexity of the dynamics, measured by the maximum Lyapunov exponent and attractor dimension, but then decreases these metrics, likely due to the proliferation of stable fixed points. We compute the marginally stable spectra of such fixed points as well as their number, showing exponential growth with network size. Finally, in chaotic states with strong Hebbian plasticity, a stable fixed point of neuronal dynamics is destabilized by synaptic dynamics, allowing any neuronal state to be stored as a stable fixed point by halting the plasticity. This phase of freezable chaos offers a new mechanism for working memory. https://doi.org/10.1103/PhysRevX.14.021001 Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Published by the American Physical Society

Bistability and Tunable Gating in a Recurrent Neuronal Network with Synaptic Failure and Hidden Neurons

Stability switches, oscillatory multistability, and spatio-temporal patterns of nonlinear oscillations in recurrently delay coupled neural networks

Bistability Analysis of Excitatory-Inhibitory Neural Networks in Limited-Sustained-Activity Regime

Hopf bifurcation in the evolution of networks driven by spike-timing-dependent plasticity.

Analysis of Cyclic Dynamics for Networks of Linear Threshold Neurons.

Theory of Coupled Neuronal-Synaptic Dynamics

Global multistability and analog circuit implementation of an adapting synapse-based neuron model

Dynamics and bifurcations in multistable 3-cell neural networks

Synaptic delay induced macroscopic dynamics of the large-scale network of Izhikevich neurons

Dynamics of Networks of Excitatory and Inhibitory Neurons in Response to Time-Dependent Inputs

Population Dynamics in Networks of Izhikevich Neurons with Global Delayed Coupling

Neural networks with transient state dynamics

Neural networks with dynamical synapses: from mixed-mode oscillations and spindles to chaos

Metastability in networks of nonlinear stochastic integrate-and-fire neurons

Emergence of Irregular Activity in Networks of Strongly Coupled Conductance-Based Neurons

Self-organization of microcircuits in networks of neurons with plastic synapses

Metastability in a stochastic neural network modeled as a velocity jump Markov process

Co-existence of synaptic plasticity and metastable dynamics in a spiking model of cortical circuits

Short-term Plasticity As a Mechanism to Regulate and Retain Multistability

Stability switches and multistability coexistence in a delay-coupled neural oscillators system.