Abstract:In neural circuits, synaptic strengths influence neuronal activity by shaping network dynamics, and neuronal activity influences synaptic strengths through activity-dependent plasticity. Motivated by this fact, we study a recurrent-network model in which neuronal units and synaptic couplings are interacting dynamic variables, with couplings subject to Hebbian modification with decay around quenched random strengths. Rather than assigning a specific role to the plasticity, we use dynamical mean-field theory and other techniques to systematically characterize the neuronal-synaptic dynamics, revealing a rich phase diagram. Adding Hebbian plasticity slows activity in already chaotic networks and can induce chaos in otherwise quiescent networks. Anti-Hebbian plasticity quickens activity and produces an oscillatory component. Analysis of the Jacobian shows that Hebbian and anti-Hebbian plasticity push locally unstable modes toward the real and imaginary axes, respectively, explaining these behaviors. Both random-matrix and Lyapunov analysis show that strong Hebbian plasticity segregates network timescales into two bands, with a slow, synapse-dominated band driving the dynamics, suggesting a flipped view of the network as synapses connected by neurons. For increasing strength, Hebbian plasticity initially raises the complexity of the dynamics, measured by the maximum Lyapunov exponent and attractor dimension, but then decreases these metrics, likely due to the proliferation of stable fixed points. We compute the marginally stable spectra of such fixed points as well as their number, showing exponential growth with network size. Finally, in chaotic states with strong Hebbian plasticity, a stable fixed point of neuronal dynamics is destabilized by synaptic dynamics, allowing any neuronal state to be stored as a stable fixed point by halting the plasticity. This phase of freezable chaos offers a new mechanism for working memory. https://doi.org/10.1103/PhysRevX.14.021001 Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Published by the American Physical Society

Network topology of neural systems supporting avalanche dynamics predicts stimulus propagation and recovery

Neuronal avalanche dynamics regulated by spike-timing-dependent plasticity under different topologies and heterogeneities

A General Description of Criticality in Neural Network Models

The effects of inhibitory and excitatory neurons on the dynamics and control of avalanching neural networks

Alternation of up and down states at a dynamical phase-transition of a neural network with spatiotemporal attractors

Broadly heterogeneous network topology begets order-based representation by privileged neurons

Revealing and reshaping attractor dynamics in large networks of cortical neurons

Network-theory based modeling of avalanche dynamics in percolative tunnelling networks

Neutral theory and scale-free neural dynamics

Activity-dependent neuronal model on complex networks

Self-organization of microcircuits in networks of neurons with plastic synapses

Statistical modeling of adaptive neural networks explains coexistence of avalanches and oscillations in resting human brain

A high-efficiency model indicating the role of inhibition in the resilience of neuronal networks to damage resulting from traumatic injury

Network algorithmics and the emergence of the cortical synaptic-weight distribution

Theory of Coupled Neuronal-Synaptic Dynamics

Criticality, Connectivity, and Neural Disorder: A Multifaceted Approach to Neural Computation

Statistical Properties of Avalanches in Networks

Excitation–Inhibition Balance, Neural Criticality, and Activities in Neuronal Circuits

The recovery of parabolic avalanches in spatially subsampled neuronal networks at criticality

Dendritic excitations govern back-propagation via a spike-rate accelerometer

Applications of Discrete Mathematics for Understanding Dynamics of Synapses and Networks in Neuroscience