Abstract:Under the framework of network-based neurodegeneration, brain functional connectome (FC)-based Graph Neural Networks (GNN) have emerged as a valuable tool for the diagnosis and prognosis of neurodegenerative diseases such as Alzheimer's disease (AD). However, these models are tailored for brain FC at a single time point instead of characterizing FC trajectory. Discerning how FC evolves with disease progression, particularly at the predementia stages such as cognitively normal individuals with amyloid deposition or individuals with mild cognitive impairment (MCI), is crucial for delineating disease spreading patterns and developing effective strategies to slow down or even halt disease advancement. In this work, we proposed the first interpretable framework for brain FC trajectory embedding with application to neurodegenerative disease diagnosis and prognosis, namely Brain Tokenized Graph Transformer (Brain TokenGT). It consists of two modules: 1) Graph Invariant and Variant Embedding (GIVE) for generation of node and spatio-temporal edge embeddings, which were tokenized for downstream processing; 2) Brain Informed Graph Transformer Readout (BIGTR) which augments previous tokens with trainable type identifiers and non-trainable node identifiers and feeds them into a standard transformer encoder to readout. We conducted extensive experiments on two public longitudinal fMRI datasets of the AD continuum for three tasks, including differentiating MCI from controls, predicting dementia conversion in MCI, and classification of amyloid positive or negative cognitively normal individuals. Based on brain FC trajectory, the proposed Brain TokenGT approach outperformed all the other benchmark models and at the same time provided excellent interpretability. The code is available at <a class="link-external link-https" href="https://github.com/ZijianD/Brain-TokenGT.git" rel="external noopener nofollow">this https URL</a>

DGST-Former: Dynamic Graph with Spatio-Temporal Transpose-Transformer for Brain fMRI Data

Dynamic Graph Transformer for Brain Disorder Diagnosis

Dynamic Adaptive Spatio-temporal Graph Convolution for fMRI Modelling

Spatio-Temporal Graph Convolution for Resting-State fMRI Analysis

Exploring Brain Effective Connectivity Networks Through Spatiotemporal Graph Convolutional Models.

Brainnetformer: Decoding Brain Cognitive States with Spatial-Temporal Cross Attention

JGAT: a joint spatio-temporal graph attention model for brain decoding

Beyond the Snapshot: Brain Tokenized Graph Transformer for Longitudinal Brain Functional Connectome Embedding

Spatio-Temporal Attention Graph Convolution Network for Functional Connectome Classification

Delving into Temporal-Spectral Connections in Spike-LFP Decoding by Transformer Networks

BrainTGL: A dynamic graph representation learning model for brain network analysis

FE-STGNN: Spatio-Temporal Graph Neural Network with Functional and Effective Connectivity Fusion for MCI Diagnosis

Dynamic Brain Transformer with Multi-level Attention for Functional Brain Network Analysis

Deep Representations for Time-varying Brain Datasets

Topgformer: Topological-Based Graph Transformer for Mapping Brain Structural Connectivity to Functional Connectivity

DynBrainGNN: Towards Spatio-Temporal Interpretable Graph Neural Network Based on Dynamic Brain Connectome for Psychiatric Diagnosis.

Spatial-Temporal DAG Convolutional Networks for End-to-End Joint Effective Connectivity Learning and Resting-State fMRI Classification

Exploring non-Euclidean relationships in EEG emotion recognition: A dynamic graph attention network

Spatial-temporal Graph Convolutional Networks with Diversified Transformation for Dynamic Graph Representation Learning

STGATE: Spatial-temporal graph attention network with a transformer encoder for EEG-based emotion recognition

Brain Network Classification Based on Dynamic Graph Attention Information Bottleneck.