Abstract:Complex neural systems can display structured emergent dynamics. Capturing this structure remains a significant scientific challenge. Using information theory, we apply Dynamical Independence (DI) to uncover the emergent dynamical structure in a minimal 5-node biophysical neural model, shaped by the interplay of two key aspects of brain organisation: integration and segregation. In our study, functional integration within the biophysical neural model is modulated by a global coupling parameter, while functional segregation is influenced by adding dynamical noise, which counteracts global coupling. DI defines a dimensionally-reduced macroscopic variable (e.g., a coarse-graining) as emergent to the extent that it behaves as an independent dynamical process, distinct from the micro-level dynamics. We measure dynamical dependence (a departure from dynamical independence) for macroscopic variables across spatial scales. Our results indicate that the degree of emergence of macroscopic variables is relatively minimised at balanced points of integration and segregation and maximised at the extremes. Additionally, our method identifies to which degree the macroscopic dynamics are localised across microlevel nodes, thereby elucidating the emergent dynamical structure through the relationship between microscopic and macroscopic processes. We find that deviation from a balanced point between integration and segregation results in a less localised, more distributed emergent dynamical structure as identified by DI. This finding suggests that a balance of functional integration and segregation is associated with lower levels of emergence (higher dynamical dependence), which may be crucial for sustaining coherent, localised emergent macroscopic dynamical structures. This work also provides a complete computational implementation for the identification of emergent neural dynamics that could be applied both in silico and in vivo.

Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks

Dynamic neurons: A statistical physics approach for analyzing deep neural networks

Dynamical Symmetry Breaking of Infinite-Dimensional Stochastic System

Symmetry Breaking in Neural Network Optimization: Insights from Input Dimension Expansion

On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theory

Fate of Duplicated Neural Structures

Deep neural networks as nested dynamical systems

Capturing the emergent dynamical structure in biophysical neural models

Synergy and Symmetry in Deep Learning: Interactions between the Data, Model, and Inference Algorithm

Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks

A Scale-Invariant Diagnostic Approach Towards Understanding Dynamics of Deep Neural Networks

Unveiling the intrinsic dynamics of biological and artificial neural networks: from criticality to optimal representations

Physical Symmetries Embedded in Neural Networks

How Can Anomalous-Diffusion Neural Networks Under Connectomics Generate Optimized Spatiotemporal Dynamics

Unification of Symmetries Inside Neural Networks: Transformer, Feedforward and Neural ODE

Connectivity structure and dynamics of nonlinear recurrent neural networks

Symmetries in Overparametrized Neural Networks: A Mean-Field View

How DNNs break the Curse of Dimensionality: Compositionality and Symmetry Learning

Unveiling the Link between Complexity and Symmetry: Statistical Asymmetry

Symmetry-regularized neural ordinary differential equations

Symmetry Breaking and Equivariant Neural Networks