Abstract:Tools from the field of graph signal processing, in particular the graph Laplacian operator, have recently been successfully applied to the investigation of structure-function relationships in the human brain. The eigenvectors of the human connectome graph Laplacian, dubbed "connectome harmonics", have been shown to relate to the functionally relevant resting-state networks. Whole-brain modelling of brain activity combines structural connectivity with local dynamical models to provide insight into the large-scale functional organization of the human brain. In this study, we employ the graph Laplacian and its properties to define and implement a large class of neural activity models directly on the human connectome. These models, consisting of systems of stochastic integrodifferential equations on graphs, are dubbed graph neural fields, in analogy with the well-established continuous neural fields. We obtain analytic predictions for harmonic and temporal power spectra, as well as functional connectivity and coherence matrices, of graph neural fields, with a technique dubbed CHAOSS (shorthand for Connectome-Harmonic Analysis Of Spatiotemporal Spectra). Combining graph neural fields with appropriate observation models allows for estimating model parameters from experimental data as obtained from electroencephalography (EEG), magnetoencephalography (MEG), or functional magnetic resonance imaging (fMRI). As an example application, we study a stochastic Wilson-Cowan graph neural field model on a high-resolution connectome graph constructed from diffusion tensor imaging (DTI) and structural MRI data. We show that the model equilibrium fluctuations can reproduce the empirically observed harmonic power spectrum of resting-state fMRI data, and predict its functional connectivity, with a high level of detail. Graph neural fields natively allow the inclusion of important features of cortical anatomy and fast computations of observable quantities for comparison with multimodal empirical data. They thus appear particularly suitable for modelling whole-brain activity at mesoscopic scales, and opening new potential avenues for connectome-graph-based investigations of structure-function relationships.

Data-driven modelling of brain activity using neural networks, Diffusion Maps, and the Koopman operator

Data-driven modelling of brain activity using neural networks, diffusion maps, and the Koopman operator

Dynamic Network Analysis of Electrophysiological Task Data

Deep Learning Nonlinear Multiscale Dynamic Problems Using Koopman Operator

A brain-network operator for modeling disease: a first data-based application for Parkinson's disease

Nonlinear functional mapping of the human brain

DeepGraphDMD: Interpretable Spatio-Temporal Decomposition of Non-linear Functional Brain Network Dynamics

On the relationship between Koopman operator approximations and neural ordinary differential equations for data-driven time-evolution predictions

Enhancing predictive capabilities in data-driven dynamical modeling with automatic differentiation: Koopman and neural ODE approaches

Neural Koopman prior for data assimilation

Towards a predictive spatio-temporal representation of brain data

On the intersection between data quality and dynamical modelling of large-scale fMRI signals

Graph neural fields: A framework for spatiotemporal dynamical models on the human connectome

Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systems

Extracting low-dimensional dynamics from multiple large-scale neural population recordings by learning to predict correlations

A Deep Graph Neural Network Architecture for Modelling Spatio-temporal Dynamics in resting-state functional MRI Data

Learning low-dimensional dynamics from whole-brain data improves task capture

Deep Representations for Time-varying Brain Datasets

Inferring Brain Dynamics via Multimodal Joint Graph Representation EEG-fMRI

Machine Learning on Dynamic Functional Connectivity: Promise, Pitfalls, and Interpretations

Spatio-temporally separable non-linear latent factor learning: an application to somatomotor cortex fMRI data