Abstract:In neural circuits, synaptic strengths influence neuronal activity by shaping network dynamics, and neuronal activity influences synaptic strengths through activity-dependent plasticity. Motivated by this fact, we study a recurrent-network model in which neuronal units and synaptic couplings are interacting dynamic variables, with couplings subject to Hebbian modification with decay around quenched random strengths. Rather than assigning a specific role to the plasticity, we use dynamical mean-field theory and other techniques to systematically characterize the neuronal-synaptic dynamics, revealing a rich phase diagram. Adding Hebbian plasticity slows activity in already chaotic networks and can induce chaos in otherwise quiescent networks. Anti-Hebbian plasticity quickens activity and produces an oscillatory component. Analysis of the Jacobian shows that Hebbian and anti-Hebbian plasticity push locally unstable modes toward the real and imaginary axes, respectively, explaining these behaviors. Both random-matrix and Lyapunov analysis show that strong Hebbian plasticity segregates network timescales into two bands, with a slow, synapse-dominated band driving the dynamics, suggesting a flipped view of the network as synapses connected by neurons. For increasing strength, Hebbian plasticity initially raises the complexity of the dynamics, measured by the maximum Lyapunov exponent and attractor dimension, but then decreases these metrics, likely due to the proliferation of stable fixed points. We compute the marginally stable spectra of such fixed points as well as their number, showing exponential growth with network size. Finally, in chaotic states with strong Hebbian plasticity, a stable fixed point of neuronal dynamics is destabilized by synaptic dynamics, allowing any neuronal state to be stored as a stable fixed point by halting the plasticity. This phase of freezable chaos offers a new mechanism for working memory. https://doi.org/10.1103/PhysRevX.14.021001 Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Published by the American Physical Society

A decaying factor accounts for contained activity in neuronal networks with no need of hierarchical or modular organization

Self-Sustained Irregular Activity in 2-D Small-World Networks of Excitatory and Inhibitory Neurons

Memory-induced mechanism for self-sustaining activity in networks

Communities in Neuronal Complex Networks Revealed by Activation Patterns

A dissipative network model with neighboring activation

Optimal Interplay between Synaptic Strengths and Network Structure Enhances Activity Fluctuations and Information Propagation in Hierarchical Modular Networks

Inhibition causes ceaseless dynamics in networks of excitable nodes

Self-sustained Activity of Low Firing Rate in Balanced Networks

Sustained Activity in Hierarchical Modular Neural Networks: Self-Organized Criticality and Oscillations.

Memory effects induce structure in social networks with activity-driven agents

Persistence of hierarchical network organization and emergent topologies in models of functional connectivity

Activation Confinement Inside Complex Networks Communities

Inhibition as a determinant of activity and criticality in dynamical networks

Simple model of complex dynamics of activity patterns in developing networks of neuronal cultures

Activity-dependent neuronal model on complex networks

From Local Chaos to Critical Slowing Down: A Theory of the Functional Connectivity of Small Neural Circuits

Emergence and maintenance of modularity in neural networks with Hebbian and anti-Hebbian inhibitory STDP

Network events on multiple space and time scales in cultured neural networks and in a stochastic rate model

Theory of Coupled Neuronal-Synaptic Dynamics

How Can Anomalous-Diffusion Neural Networks Under Connectomics Generate Optimized Spatiotemporal Dynamics

Emergence and long-term maintenance of modularity in plastic networks of spiking neurons