Abstract:Mounting evidence has demonstrated that complex brain function processes are realized by the interaction of holistic functional brain networks which are spatially distributed across specific brain regions in a temporally dynamic fashion. Therefore, modeling spatio-temporal patterns of holistic functional brain networks plays an important role in understanding brain function. Compared to traditional modeling methods such as principal component analysis, independent component analysis, and sparse coding, superior performance has been achieved by recent deep learning methodologies. However, there are still two limitations of existing deep learning approaches for functional brain network modeling. They either (1) merely modeled a single targeted network and ignored holistic ones at one time, or (2) underutilized both spatial and temporal features of fMRI during network modeling, and the spatial/temporal accuracy was thus not warranted. To address these limitations, we proposed a novel Multi-Head Guided Attention Graph Neural Network (Multi-Head GAGNN) to simultaneously model both spatial and temporal patterns of holistic functional brain networks. Specifically, a spatial Multi-Head Attention Graph U-Net was first adopted to model the spatial patterns of multiple brain networks, and a temporal Multi-Head Guided Attention Network was then introduced to model the corresponding temporal patterns under the guidance of modeled spatial patterns. Based on seven task fMRI datasets from the public Human Connectome Project and resting state fMRI datasets from the public Autism Brain Imaging Data Exchange I of 1448 subjects, the proposed Multi-Head GAGNN showed superior ability and generalizability in modeling both spatial and temporal patterns of holistic functional brain networks in individual brains compared to other state-of-the-art (SOTA) models. Furthermore, the modeled spatio-temporal patterns of functional brain networks via the proposed Multi-Head GAGNN can better predict the individual cognitive behavioral measures compared to the other SOTA models. This study provided a novel and powerful tool for brain function modeling as well as for understanding the brain-cognitive behavior associations.

Hypercomplex Graph Neural Network: Towards Deep Intersection of Multi-modal Brain Networks

Mapping Multi-Modal Brain Connectome for Brain Disorder Diagnosis Via Cross-Modal Mutual Learning.

Tensor-based Complex-valued Graph Neural Network for Dynamic Coupling Multimodal Brain Networks

Multi-modal Dynamic Graph Network: Coupling Structural and Functional Connectome for Disease Diagnosis and Classification

A novel interactive deep cascade spectral graph convolutional network with multi-relational graphs for disease prediction

Joint Embedding of Structural and Functional Brain Networks with Graph Neural Networks for Mental Illness Diagnosis

Heterogeneous Graph-Based Multimodal Brain Network Learning

A Heterogeneous Graph Neural Network Fusing Functional and Structural Connectivity for MCI Diagnosis

A Heterogeneous Graph Based Framework for Multimodal Neuroimaging Fusion Learning

MSTGC: Multi-Channel Spatio-Temporal Graph Convolution Network for Multi-Modal Brain Networks Fusion

Multiplex Graph Networks for Multimodal Brain Network Analysis

HGNN$^+$: General Hypergraph Neural Networks

Knowledge-driven multi-graph convolutional network for brain network analysis and potential biomarker discovery

Modeling spatio-temporal patterns of holistic functional brain networks via multi-head guided attention graph neural networks (Multi-Head GAGNNs)

Dynamic Weighted Hypergraph Convolutional Network for Brain Functional Connectome Analysis

Deep Representation Learning For Multimodal Brain Networks

Hi-GCN: A Hierarchical Graph Convolution Network for Graph Embedding Learning of Brain Network and Brain Disorders Prediction.

Residual Enhanced Multi-Hypergraph Neural Network

Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysis

TGNet: tensor-based graph convolutional networks for multimodal brain network analysis

A Multimodal Graph Neural Network Framework of Cancer Molecular Subtype Classification