Abstract:Mounting evidence has demonstrated that complex brain function processes are realized by the interaction of holistic functional brain networks which are spatially distributed across specific brain regions in a temporally dynamic fashion. Therefore, modeling spatio-temporal patterns of holistic functional brain networks plays an important role in understanding brain function. Compared to traditional modeling methods such as principal component analysis, independent component analysis, and sparse coding, superior performance has been achieved by recent deep learning methodologies. However, there are still two limitations of existing deep learning approaches for functional brain network modeling. They either (1) merely modeled a single targeted network and ignored holistic ones at one time, or (2) underutilized both spatial and temporal features of fMRI during network modeling, and the spatial/temporal accuracy was thus not warranted. To address these limitations, we proposed a novel Multi-Head Guided Attention Graph Neural Network (Multi-Head GAGNN) to simultaneously model both spatial and temporal patterns of holistic functional brain networks. Specifically, a spatial Multi-Head Attention Graph U-Net was first adopted to model the spatial patterns of multiple brain networks, and a temporal Multi-Head Guided Attention Network was then introduced to model the corresponding temporal patterns under the guidance of modeled spatial patterns. Based on seven task fMRI datasets from the public Human Connectome Project and resting state fMRI datasets from the public Autism Brain Imaging Data Exchange I of 1448 subjects, the proposed Multi-Head GAGNN showed superior ability and generalizability in modeling both spatial and temporal patterns of holistic functional brain networks in individual brains compared to other state-of-the-art (SOTA) models. Furthermore, the modeled spatio-temporal patterns of functional brain networks via the proposed Multi-Head GAGNN can better predict the individual cognitive behavioral measures compared to the other SOTA models. This study provided a novel and powerful tool for brain function modeling as well as for understanding the brain-cognitive behavior associations.

Modeling Brain Networks with Artificial Neural Networks

A Probabilistic Model of Functional Brain Connectivity Network for Discovering Novel Biomarkers.

A Variational Bayesian Approach to Identifying Whole-Brain Directed Networks with Fmri Data

Brain Effective Connectivity Modeling for Alzheimer's Disease by Sparse Gaussian Bayesian Network.

Research on Modeling Approach of Brain Function Network Based on Anatomical Distance

Functional2Structural: Cross-Modality Brain Networks Representation Learning

A New Method for Automatically Modelling Brain Functional Networks.

Encoding Multi-Resolution Brain Networks Using Unsupervised Deep Learning

Network modeling of dynamic brain interactions predicts emergence of neural information that supports human cognitive behavior

Exploring Brain Effective Connectivity in Visual Perception Using a Hierarchical Correlation Network.

Fmri-Based Brain Disease Diagnosis: A Graph Network Approach

Bayesian Joint Modeling of Multiple Brain Functional Networks

Brain Networks and Intelligence: A Graph Neural Network Based Approach to Resting State fMRI Data

Neural Networks, Artificial Intelligence and the Computational Brain

Modelling and Analysis of Brain Functional Network

Integrated Brain Connectivity Analysis with fMRI, DTI, and sMRI Powered by Interpretable Graph Neural Networks

Visual Analysis of Brain Networks Using Sparse Regression Models.

Modeling spatio-temporal patterns of holistic functional brain networks via multi-head guided attention graph neural networks (Multi-Head GAGNNs)

Deep Neural Networks Carve the Brain at its Joints

Data-driven brain network models predict individual variability in behavior