Abstract:Complex neural systems can display structured emergent dynamics. Capturing this structure remains a significant scientific challenge. Using information theory, we apply Dynamical Independence (DI) to uncover the emergent dynamical structure in a minimal 5-node biophysical neural model, shaped by the interplay of two key aspects of brain organisation: integration and segregation. In our study, functional integration within the biophysical neural model is modulated by a global coupling parameter, while functional segregation is influenced by adding dynamical noise, which counteracts global coupling. DI defines a dimensionally-reduced macroscopic variable (e.g., a coarse-graining) as emergent to the extent that it behaves as an independent dynamical process, distinct from the micro-level dynamics. We measure dynamical dependence (a departure from dynamical independence) for macroscopic variables across spatial scales. Our results indicate that the degree of emergence of macroscopic variables is relatively minimised at balanced points of integration and segregation and maximised at the extremes. Additionally, our method identifies to which degree the macroscopic dynamics are localised across microlevel nodes, thereby elucidating the emergent dynamical structure through the relationship between microscopic and macroscopic processes. We find that deviation from a balanced point between integration and segregation results in a less localised, more distributed emergent dynamical structure as identified by DI. This finding suggests that a balance of functional integration and segregation is associated with lower levels of emergence (higher dynamical dependence), which may be crucial for sustaining coherent, localised emergent macroscopic dynamical structures. This work also provides a complete computational implementation for the identification of emergent neural dynamics that could be applied both in silico and in vivo.

Deep neural networks as nested dynamical systems

A brain basis of dynamical intelligence for AI and computational neuroscience

Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks

Deep learning systems as complex networks

Dynamical systems' based neural networks

Dictionary Learning by Dynamical Neural Networks

Self-organization of multi-layer spiking neural networks

Dynamical Equations With Bottom-up Self-Organizing Properties Learn Accurate Dynamical Hierarchies Without Any Loss Function

Towards Biologically Plausible Deep Learning

Neural circuits as computational dynamical systems

Neural networks with transient state dynamics

Dynamic neurons: A statistical physics approach for analyzing deep neural networks

Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments

Continual Learning with Deep Artificial Neurons

Beyond Geometry: Comparing the Temporal Structure of Computation in Neural Circuits with Dynamical Similarity Analysis

Neurodynamical Computing at the Information Boundaries of Intelligent Systems

Deep learning incorporating biologically-inspired neural dynamics

Capturing the emergent dynamical structure in biophysical neural models

On Neural Differential Equations

The sloppy relationship between neural circuit structure and function

Deep neural networks from the perspective of ergodic theory