Abstract:Mounting evidence has demonstrated that complex brain function processes are realized by the interaction of holistic functional brain networks which are spatially distributed across specific brain regions in a temporally dynamic fashion. Therefore, modeling spatio-temporal patterns of holistic functional brain networks plays an important role in understanding brain function. Compared to traditional modeling methods such as principal component analysis, independent component analysis, and sparse coding, superior performance has been achieved by recent deep learning methodologies. However, there are still two limitations of existing deep learning approaches for functional brain network modeling. They either (1) merely modeled a single targeted network and ignored holistic ones at one time, or (2) underutilized both spatial and temporal features of fMRI during network modeling, and the spatial/temporal accuracy was thus not warranted. To address these limitations, we proposed a novel Multi-Head Guided Attention Graph Neural Network (Multi-Head GAGNN) to simultaneously model both spatial and temporal patterns of holistic functional brain networks. Specifically, a spatial Multi-Head Attention Graph U-Net was first adopted to model the spatial patterns of multiple brain networks, and a temporal Multi-Head Guided Attention Network was then introduced to model the corresponding temporal patterns under the guidance of modeled spatial patterns. Based on seven task fMRI datasets from the public Human Connectome Project and resting state fMRI datasets from the public Autism Brain Imaging Data Exchange I of 1448 subjects, the proposed Multi-Head GAGNN showed superior ability and generalizability in modeling both spatial and temporal patterns of holistic functional brain networks in individual brains compared to other state-of-the-art (SOTA) models. Furthermore, the modeled spatio-temporal patterns of functional brain networks via the proposed Multi-Head GAGNN can better predict the individual cognitive behavioral measures compared to the other SOTA models. This study provided a novel and powerful tool for brain function modeling as well as for understanding the brain-cognitive behavior associations.

Multi-Scale Spatial-Temporal Attention Networks for Functional Connectome Classification

Spatio-Temporal Attention Graph Convolution Network for Functional Connectome Classification

A Multi-Graph Cross-Attention based Region-Aware Feature Fusion Network using Multi-Template for Brain Disorder Diagnosis

A Mutual Multi-Scale Triplet Graph Convolutional Network for Classification of Brain Disorders Using Functional or Structural Connectivity

Characterizing Functional Brain Networks Via Spatio-Temporal Attention 4D Convolutional Neural Networks (Sta-4Dcnns)

HAGCN: A hybrid-order brain network-based graph convolution learning framework with multi-head attention for brain disorder classification

Hierarchical Graph Convolutional Network Built by Multiscale Atlases for Brain Disorder Diagnosis Using Functional Connectivity

fMRI classification method with multiple feature fusion based on minimum spanning tree analysis.

Spatio‐temporal Graph Convolutional Network for Diagnosis and Treatment Response Prediction of Major Depressive Disorder from Functional Connectivity

Deep Fusion of Multi-Template using Spatio-Temporal Weighted Multi-Hypergraph Convolutional Networks for Brain Disease Analysis

FC-HAT: Hypergraph attention network for functional brain network classification

Multi-modal Dynamic Graph Network: Coupling Structural and Functional Connectome for Disease Diagnosis and Classification

Multi-Connectivity Representation Learning Network for Major Depressive Disorder Diagnosis

Spatial-Temporal Convolutional Attention for Mapping Functional Brain Networks.

Multi-SIGATnet: A multimodal schizophrenia MRI classification algorithm using sparse interaction mechanisms and graph attention networks

Modeling spatio-temporal patterns of holistic functional brain networks via multi-head guided attention graph neural networks (Multi-Head GAGNNs)

ST-ASDNET: A BLSTM-FCN-Transformer basedASD Classification Model for Time-series fMRI

Enhancing the Representation of Functional Connectivity Networks by Fusing Multi-View Information for Autism Spectrum Disorder Diagnosis

Spatial-temporal data-augmentation-based functional brain network analysis for brain disorders identification

Multi-head attention-based masked sequence model for mapping functional brain networks

Knowledge-aware Multisite Adaptive Graph Transformer for Brain Disorder Diagnosis