Abstract:In neural circuits, synaptic strengths influence neuronal activity by shaping network dynamics, and neuronal activity influences synaptic strengths through activity-dependent plasticity. Motivated by this fact, we study a recurrent-network model in which neuronal units and synaptic couplings are interacting dynamic variables, with couplings subject to Hebbian modification with decay around quenched random strengths. Rather than assigning a specific role to the plasticity, we use dynamical mean-field theory and other techniques to systematically characterize the neuronal-synaptic dynamics, revealing a rich phase diagram. Adding Hebbian plasticity slows activity in chaotic networks and can induce chaos in otherwise quiescent networks. Anti-Hebbian plasticity quickens activity and produces an oscillatory component. Analysis of the Jacobian shows that Hebbian and anti-Hebbian plasticity push locally unstable modes toward the real and imaginary axes, explaining these behaviors. Both random-matrix and Lyapunov analysis show that strong Hebbian plasticity segregates network timescales into two bands with a slow, synapse-dominated band driving the dynamics, suggesting a flipped view of the network as synapses connected by neurons. For increasing strength, Hebbian plasticity initially raises the complexity of the dynamics, measured by the maximum Lyapunov exponent and attractor dimension, but then decreases these metrics, likely due to the proliferation of stable fixed points. We compute the marginally stable spectra of such fixed points as well as their number, showing exponential growth with network size. In chaotic states with strong Hebbian plasticity, a stable fixed point of neuronal dynamics is destabilized by synaptic dynamics, allowing any neuronal state to be stored as a stable fixed point by halting the plasticity. This phase of freezable chaos offers a new mechanism for working memory.

Consequences of Dale's law on the stability-complexity relationship of random neural networks

Eigenvalue spectral properties of sparse random matrices obeying Dale's law

Critical excitation-inhibition balance in dense neural networks

From asynchronous states to Griffiths phases and back: structural heterogeneity and homeostasis in excitatory-inhibitory networks

Transition to chaos separates learning regimes and relates to measure of consciousness in recurrent neural networks

Neutral theory and scale-free neural dynamics

Dynamics of a two-layer neuronal network with asymmetry in coupling

Theory of coupled neuronal-synaptic dynamics

Approximating nonlinear functions with latent boundaries in low-rank excitatory-inhibitory spiking networks

Neutral stability, rate propagation, and critical branching in feedforward networks

Noise-induced phase transitions in neuronal networks

Transition to chaos in random networks with cell-type-specific connectivity

Learning and Structure of Neuronal Networks

Large deviations, dynamics and phase transitions in large stochastic heterogeneous neural networks

Dynamical Mean-Field Theory of Complex Systems on Sparse Directed Networks

Stable Irregular Dynamics in Complex Neural Networks

Multiple Phase Transitions for an Infinite System of Spiking Neurons

Unveiling the intrinsic dynamics of biological and artificial neural networks: from criticality to optimal representations

How high dimensional neural dynamics are confined in phase space