Abstract:Resting-state functional magnetic resonance imaging (rs-fMRI) is a noninvasive technique pivotal for understanding human neural mechanisms of intricate cognitive processes. Most rs-fMRI studies compute a single static functional connectivity matrix across brain regions of interest, or dynamic functional connectivity matrices with a sliding window approach. These approaches are at risk of oversimplifying brain dynamics and lack proper consideration of the goal at hand. While deep learning has gained substantial popularity for modeling complex relational data, its application to uncovering the spatiotemporal dynamics of the brain is still limited. We propose a novel interpretable deep learning framework that learns goal-specific functional connectivity matrix directly from time series and employs a specialized graph neural network for the final classification. Our model, DSAM, leverages temporal causal convolutional networks to capture the temporal dynamics in both low- and high-level feature representations, a temporal attention unit to identify important time points, a self-attention unit to construct the goal-specific connectivity matrix, and a novel variant of graph neural network to capture the spatial dynamics for downstream classification. To validate our approach, we conducted experiments on the Human Connectome Project dataset with 1075 samples to build and interpret the model for the classification of sex group, and the Adolescent Brain Cognitive Development Dataset with 8520 samples for independent testing. Compared our proposed framework with other state-of-art models, results suggested this novel approach goes beyond the assumption of a fixed connectivity matrix and provides evidence of goal-specific brain connectivity patterns, which opens up the potential to gain deeper insights into how the human brain adapts its functional connectivity specific to the task at hand.

MCAN: Multimodal Causal Adversarial Networks for Dynamic Effective Connectivity Learning from fMRI and EEG Data

Discovering Dynamic Effective Connectome of Brain with Bayesian Dynamic DAG Learning

EC-GAN: Inferring Brain Effective Connectivity via Generative Adversarial Networks

Fusing Structural and Functional Connectivities using Disentangled VAE for Detecting MCI

MetaCAE: Causal autoencoder with meta-knowledge transfer for brain effective connectivity estimation

A Deep Dynamic Causal Learning Model to Study Changes in Dynamic Effective Connectivity during Brain Development

Brain Imaging-to-Graph Generation using Adversarial Hierarchical Diffusion Models for MCI Causality Analysis

Bayesian fusion and multimodal DCM for EEG and fMRI

Virtual Adversarial Training-Based Deep Feature Aggregation Network From Dynamic Effective Connectivity for MCI Identification

Modality-Aware Discriminative Fusion Network for Integrated Analysis of Brain Imaging Genomics

Effective Connectivity-Based Neural Decoding: A Causal Interaction-Driven Approach

Generalized Recurrent Neural Network accommodating Dynamic Causal Modeling for functional MRI analysis

[Study of Effective Connectivity Based on Dynamic Causal Modeling in Subtraction Calculation Task].

Dynamical Differential Covariance Based Brain Network for Motor Intent Recognition

SCDAN: Learning Common Feature Representation of Brain Activation for Intersubject Motor Imagery EEG Decoding

Constructing Time-Varying Directed EEG Network by Multivariate Nonparametric Dynamical Granger Causality

DSAM: A Deep Learning Framework for Analyzing Temporal and Spatial Dynamics in Brain Networks

Joint Learning of Multiple Differential Networks with fMRI data for Brain Connectivity Alteration Detection

A strategy of model space search for dynamic causal modeling in task fMRI data exploratory analysis

Spatial-Temporal DAG Convolutional Networks for End-to-End Joint Effective Connectivity Learning and Resting-State fMRI Classification

Modeling Task Fmri Data Via Deep Convolutional Autoencoder