Abstract:We consider a simple neural network model, evolving via non-linear coupled stochastic differential equations, where neural couplings are random Gaussian variables with non-zero mean and arbitrary degree of reciprocity. Using a path-integral approach, we analyse the dynamics, averaged over the network ensemble, in the thermodynamic limit. Our results show that for any degree of reciprocity in the couplings, two types of criticality emerge, corresponding to ferromagnetic and spin-glass order, respectively. The critical lines separating the disordered from the ordered phases is consistent with spectral properties of the coupling matrix, as derived from random matrix theory. As the non-reciprocity (or asymmetry) in the couplings increases, both ordered phases diminish in size, ultimately resulting in the disappearance of the spin-glass phase when the couplings become anti-symmetric. We investigate non-fixed point steady-state solutions for uncorrelated interactions. For such solutions the time-lagged correlation function evolves according to a gradient-descent dynamics on a potential, which depends on the stationary variance. Our analysis shows that in the spin-glass region, the variance dynamically selected by the system leads the correlation function to evolve on the separatrix curve, limiting different realizable steady states, whereas in the ferromagnetic region, a fixed point solution is selected as the only realizable steady state. In the spin-glass region, stationary solutions are unstable against perturbations that break time-translation invariance, indicating chaotic behaviour in large single network instances. Numerical analysis of Lyapunov exponents confirms that chaotic behaviour emerges throughout the spin-glass region, for any value of the coupling correlations. While negative correlations increase the strength of chaos, positive ones reduce it, with chaos disappearing for reciprocal (i.e. symmetric) couplings, where marginal stability is attained. On the other hand, in finite size non-reciprocal networks, fixed points and limit cycles can arise in the spin-glass region, especially close to the critical line. Finally, we show that chaos is suppressed when the strength of external noise exceeds a certain threshold. Intriguing analogies between chaotic phases in non-equilibrium systems and spin-glass phases in equilibrium are put forward.

Refractory period in network models of excitable nodes: self-sustaining stable dynamics, extended scaling region and oscillatory behavior

Critical Branching Dynamics in Excitable Network Without Refractory Periods

Effects of Refractory Period on Dynamical Range in Excitable Networks

Inhibition causes ceaseless dynamics in networks of excitable nodes

Self Organized Criticality in a Mesoscopic Model of Excitatory-Inhibitory Neuronal Populations by Short-term and Long-term Synaptic Plasticity

A toy model for brain criticality: self-organized excitation/inhibition ratio and the role of network clustering

Analysis of Cyclic Dynamics for Networks of Linear Threshold Neurons.

Critical behaviour of the stochastic Wilson-Cowan model

Oscillations and irregular persistent firing patterns in a homogeneous network of excitatory stochastic neurons with gap junctions in the mean-field limit

A General Description of Criticality in Neural Network Models

Stochastic oscillations produce dragon king avalanches in self-organized quasi-critical systems

Phase transitions and self-organized criticality in networks of stochastic spiking neurons

Dynamical synapses causing self-organized criticality in neural networks

Scale Free Avalanches in Excitatory-Inhibitory Populations of Spiking Neurons with Conductance Based Synaptic Currents

Emergence of complex oscillatory dynamics in the neuronal networks with long activity time of inhibitory synapses

Self-organized critical network dynamics

Dynamically selected steady states and criticality in non-reciprocal networks

Hopf Bifurcation In Mean Field Explains Critical Avalanches In Excitation-Inhibition Balanced Neuronal Networks: A Mechanism For Multiscale Variability

Activity-dependent neuronal model on complex networks

Neutral stability, rate propagation, and critical branching in feedforward networks

Structural Modularity Tunes Mesoscale Criticality in Biological Neuronal Networks