Abstract:Mounting evidence has demonstrated that complex brain function processes are realized by the interaction of holistic functional brain networks which are spatially distributed across specific brain regions in a temporally dynamic fashion. Therefore, modeling spatio-temporal patterns of holistic functional brain networks plays an important role in understanding brain function. Compared to traditional modeling methods such as principal component analysis, independent component analysis, and sparse coding, superior performance has been achieved by recent deep learning methodologies. However, there are still two limitations of existing deep learning approaches for functional brain network modeling. They either (1) merely modeled a single targeted network and ignored holistic ones at one time, or (2) underutilized both spatial and temporal features of fMRI during network modeling, and the spatial/temporal accuracy was thus not warranted. To address these limitations, we proposed a novel Multi-Head Guided Attention Graph Neural Network (Multi-Head GAGNN) to simultaneously model both spatial and temporal patterns of holistic functional brain networks. Specifically, a spatial Multi-Head Attention Graph U-Net was first adopted to model the spatial patterns of multiple brain networks, and a temporal Multi-Head Guided Attention Network was then introduced to model the corresponding temporal patterns under the guidance of modeled spatial patterns. Based on seven task fMRI datasets from the public Human Connectome Project and resting state fMRI datasets from the public Autism Brain Imaging Data Exchange I of 1448 subjects, the proposed Multi-Head GAGNN showed superior ability and generalizability in modeling both spatial and temporal patterns of holistic functional brain networks in individual brains compared to other state-of-the-art (SOTA) models. Furthermore, the modeled spatio-temporal patterns of functional brain networks via the proposed Multi-Head GAGNN can better predict the individual cognitive behavioral measures compared to the other SOTA models. This study provided a novel and powerful tool for brain function modeling as well as for understanding the brain-cognitive behavior associations.

Identifying Individualized Functional Brain Networks: an Unsupervised Deep Temporal Attention Based Autoencoder Model

Mapping dynamic spatial patterns of brain function with spatial-wise attention

Discovering Dynamic Functional Brain Networks via Spatial and Channel-wise Attention

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Characterizing Functional Brain Networks Via Spatio-Temporal Attention 4D Convolutional Neural Networks (Sta-4Dcnns)

Functional connectome fingerprinting: Identifying individuals and predicting cognitive functions via autoencoder

Identifying Functional Brain Networks of Spatiotemporal Wide-Field Calcium Imaging Data via a Long Short-Term Memory Autoencoder

Exploring Brain Hemodynamic Response Patterns Via Deep Recurrent Autoencoder

Dynamic Brain Transformer with Multi-level Attention for Functional Brain Network Analysis

BrainMAE: A Region-aware Self-supervised Learning Framework for Brain Signals

Second-order processes in vision: introduction.

Spatial-temporal convolutional attention for discovering and characterizing functional brain networks in task fMRI

Modeling Task Fmri Data Via Deep Convolutional Autoencoder

Temporal attention fusion network with custom loss function for EEG--fNIRS classification

Modeling spatio-temporal patterns of holistic functional brain networks via multi-head guided attention graph neural networks (Multi-Head GAGNNs)

Attention module improves both performance and interpretability of four‐dimensional functional magnetic resonance imaging decoding neural network

Deep Variational Autoencoder for Mapping Functional Brain Networks

Dynamic functional connectivity analysis with temporal convolutional network for attention deficit/hyperactivity disorder identification

Attention module improves both performance and interpretability of 4D fMRI decoding neural network

DSAM: A Deep Learning Framework for Analyzing Temporal and Spatial Dynamics in Brain Networks

State-space model with deep learning for functional dynamics estimation in resting-state fMRI