Abstract:We consider a simple neural network model, evolving via non-linear coupled stochastic differential equations, where neural couplings are random Gaussian variables with non-zero mean and arbitrary degree of reciprocity. Using a path-integral approach, we analyse the dynamics, averaged over the network ensemble, in the thermodynamic limit. Our results show that for any degree of reciprocity in the couplings, two types of criticality emerge, corresponding to ferromagnetic and spin-glass order, respectively. The critical lines separating the disordered from the ordered phases is consistent with spectral properties of the coupling matrix, as derived from random matrix theory. As the non-reciprocity (or asymmetry) in the couplings increases, both ordered phases diminish in size, ultimately resulting in the disappearance of the spin-glass phase when the couplings become anti-symmetric. We investigate non-fixed point steady-state solutions for uncorrelated interactions. For such solutions the time-lagged correlation function evolves according to a gradient-descent dynamics on a potential, which depends on the stationary variance. Our analysis shows that in the spin-glass region, the variance dynamically selected by the system leads the correlation function to evolve on the separatrix curve, limiting different realizable steady states, whereas in the ferromagnetic region, a fixed point solution is selected as the only realizable steady state. In the spin-glass region, stationary solutions are unstable against perturbations that break time-translation invariance, indicating chaotic behaviour in large single network instances. Numerical analysis of Lyapunov exponents confirms that chaotic behaviour emerges throughout the spin-glass region, for any value of the coupling correlations. While negative correlations increase the strength of chaos, positive ones reduce it, with chaos disappearing for reciprocal (i.e. symmetric) couplings, where marginal stability is attained. On the other hand, in finite size non-reciprocal networks, fixed points and limit cycles can arise in the spin-glass region, especially close to the critical line. Finally, we show that chaos is suppressed when the strength of external noise exceeds a certain threshold. Intriguing analogies between chaotic phases in non-equilibrium systems and spin-glass phases in equilibrium are put forward.

Finite size effects in the correlation structure of stochastic neural networks: analysis of different connectivity matrices and failure of the mean-field theory

A stochastic-field description of finite-size spiking neural networks

Firing rate and spatial correlation in a stochastic neural field model

Non-exchangeable networks of integrate-and-fire neurons: spatially-extended mean-field limit of the empirical measure

Linking Network and Neuron-level Correlations by Renormalized Field Theory

The determining role of covariances in large networks of stochastic neurons

From Local Chaos to Critical Slowing Down: A Theory of the Functional Connectivity of Small Neural Circuits

Noise-induced behaviors in neural mean field dynamics

Neural Fields and Noise-Induced Patterns in Neurons on Large Disordered Networks

Mathematical studies of the dynamics of finite-size binary neural networks: A review of recent progress

Coherent chaos in a recurrent neural network with structured connectivity

Finite Size Effects in Separable Recurrent Neural Networks

Echoes in correlated neural systems

Laws of Large Numbers and Langevin Approximations for Stochastic Neural Field Equations

How single neuron properties shape chaotic dynamics and signal transmission in random neural networks

Dynamically selected steady states and criticality in non-reciprocal networks

Coherence Resonance in Random Erdös-Rényi Neural Networks: Mean-Field Theory

Fluctuations for mean field limits of interacting systems of spiking neurons

Mean Field Analysis of Stochastic Neural Network Models with Synaptic Depression

Limits and dynamics of stochastic neuronal networks with random heterogeneous delays