Abstract:Mounting evidence has demonstrated that complex brain function processes are realized by the interaction of holistic functional brain networks which are spatially distributed across specific brain regions in a temporally dynamic fashion. Therefore, modeling spatio-temporal patterns of holistic functional brain networks plays an important role in understanding brain function. Compared to traditional modeling methods such as principal component analysis, independent component analysis, and sparse coding, superior performance has been achieved by recent deep learning methodologies. However, there are still two limitations of existing deep learning approaches for functional brain network modeling. They either (1) merely modeled a single targeted network and ignored holistic ones at one time, or (2) underutilized both spatial and temporal features of fMRI during network modeling, and the spatial/temporal accuracy was thus not warranted. To address these limitations, we proposed a novel Multi-Head Guided Attention Graph Neural Network (Multi-Head GAGNN) to simultaneously model both spatial and temporal patterns of holistic functional brain networks. Specifically, a spatial Multi-Head Attention Graph U-Net was first adopted to model the spatial patterns of multiple brain networks, and a temporal Multi-Head Guided Attention Network was then introduced to model the corresponding temporal patterns under the guidance of modeled spatial patterns. Based on seven task fMRI datasets from the public Human Connectome Project and resting state fMRI datasets from the public Autism Brain Imaging Data Exchange I of 1448 subjects, the proposed Multi-Head GAGNN showed superior ability and generalizability in modeling both spatial and temporal patterns of holistic functional brain networks in individual brains compared to other state-of-the-art (SOTA) models. Furthermore, the modeled spatio-temporal patterns of functional brain networks via the proposed Multi-Head GAGNN can better predict the individual cognitive behavioral measures compared to the other SOTA models. This study provided a novel and powerful tool for brain function modeling as well as for understanding the brain-cognitive behavior associations.

DEEP DAG LEARNING OF EFFECTIVE BRAIN CONNECTIVITY FOR FMRI ANALYSIS

Learning Task-Aware Effective Brain Connectivity for fMRI Analysis with Graph Neural Networks

FBNETGEN: Task-aware GNN-based fMRI Analysis via Functional Brain Network Generation

Spatial-Temporal DAG Convolutional Networks for End-to-End Joint Effective Connectivity Learning and Resting-State fMRI Classification

Deep reinforcement learning guided graph neural networks for brain network analysis

BrainGNN: Interpretable Brain Graph Neural Network for fMRI Analysis

Deep Variational Autoencoder for Mapping Functional Brain Networks

Brain Functional Connectivity Analysis via Graphical Deep Learning

Effective and Interpretable fMRI Analysis via Functional Brain Network Generation

Benchmarking Graph Neural Networks for FMRI analysis

DynDepNet: Learning Time-Varying Dependency Structures from fMRI Data via Dynamic Graph Structure Learning

Graph neural network based on brain inspired forward-forward mechanism for motor imagery classification in brain-computer interfaces

Modeling Task Fmri Data Via Deep Convolutional Autoencoder

DouGNN: An End-to-End Deep Learning Framework for Predicting Individual Behaviors from fMRI Data

Supervised Brain Network Learning Based on Deep Recurrent Neural Networks.

Deep Representation Learning For Multimodal Brain Networks

Voxel-Level Fmri Analysis by Representation Learning and Deep Clustering for Alzheimer's Disease.

Modeling spatio-temporal patterns of holistic functional brain networks via multi-head guided attention graph neural networks (Multi-Head GAGNNs)

Functional brain network identification and fMRI augmentation using a VAE-GAN framework

Disentangling time series between brain tissues improves fMRI data quality using a time-dependent deep neural network

Deep Representations for Time-varying Brain Datasets