Deep Variational Autoencoder for Mapping Functional Brain Networks

Ning Qiang,Qinglin Dong,Fangfei Ge,Hongtao Liang,Bao Ge,Shu Zhang,Yifei Sun,Jie Gao,Tianming Liu

DOI: https://doi.org/10.1109/tcds.2020.3025137

IF: 4.546

2021-12-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:In the neuroimaging and brain mapping communities, researchers have proposed a variety of computational methods to map functional brain networks (FBNs). Recently, it has been proven that deep learning (DL) can be applied on functional magnetic resonance image (fMRI) data with superb representation power over the traditional machine learning methods. However, due to the lack of labeled data and the high dimension of fMRI volume images, DL suffers from overfitting in both supervised and unsupervised training processes. In this work, we proposed a novel generative model: deep variational autoencoder (DVAE) to tackle the challenge of insufficient data and incomplete supervision. The experimental results showed that the representations learned by DVAE are interpretable and meaningful compared to those learned from well-known sparse dictionary learning (SDL). Besides, the organization of some FBN patterns derived from different layers in DVAE was observed in a hierarchical fashion. Furthermore, we showed that DVAE has better performance on small dataset over autoencoder (AE). By using attention deficit hyperactivity disorder (ADHD)-200 dataset as our test bed, we constructed a DVAE-based modeling and classification pipeline in which all subjects' functional connectivities estimated by FBNs were taken as input features to train a classifier. Finally, the results achieved by our pipeline reached state-of-the-art classification accuracies on three ADHD-200 sites compared with other fMRI-based methods.

robotics,computer science, artificial intelligence,neurosciences

What problem does this paper attempt to address?

The main problem this paper attempts to address is the overfitting issue in functional brain networks (FBNs) modeling using deep learning methods. Specifically, due to the typically small sample size and high dimensionality of functional magnetic resonance imaging (fMRI) datasets, deep learning models are prone to overfitting during both supervised and unsupervised training processes. Additionally, the lack of high-quality labels makes it difficult to apply supervised learning methods. To address these issues, the authors propose a new method based on Deep Variational Autoencoder (DVAE). DVAE can effectively overcome the problem of insufficient data and extract more generalizable features from high-dimensional fMRI data. Experimental results show that DVAE outperforms traditional Autoencoders (AE) on small datasets and can generate interpretable and meaningful functional brain network patterns. Furthermore, the authors demonstrate that the functional brain network patterns extracted by DVAE in different layers exhibit hierarchical organization, similar to the functional architecture of the human brain. To validate the proposed method, the authors conducted experiments using the ADHD-200 dataset and constructed a DVAE-based modeling and classification pipeline. Ultimately, this pipeline achieved state-of-the-art classification accuracy across three ADHD-200 sites, demonstrating its effectiveness in the problem of brain disease classification.

Deep Variational Autoencoder for Mapping Functional Brain Networks

Modeling and augmenting of fMRI data using deep recurrent variational auto-encoder

Functional brain network identification and fMRI augmentation using a VAE-GAN framework

Modeling Task Fmri Data Via Deep Convolutional Autoencoder

A deep learning method for autism spectrum disorder identification based on interactions of hierarchical brain networks

DEEP DAG LEARNING OF EFFECTIVE BRAIN CONNECTIVITY FOR FMRI ANALYSIS

A deep autoencoder with sparse and graph Laplacian regularization for characterizing dynamic functional connectivity during brain development

Identifying Functional Brain Networks under Naturalistic Paradigm Via A Three-Dimensional Spatial Attention Convolution Autoencoder

Variational Autoencoder: An Unsupervised Model for Modeling and Decoding fMRI Activity in Visual Cortex

Constructing Fine-Granularity Functional Brain Network Atlases Via Deep Convolutional Autoencoder.

Exploring Brain Hemodynamic Response Patterns Via Deep Recurrent Autoencoder

Deep Neural Generative Adversarial Model based on VAE + GAN for Disorder Diagnosis

Modeling Hierarchical Spatial and Temporal Patterns of Naturalistic Fmri Volume Via Volumetric Deep Belief Network with Neural Architecture Search.

A Novel Transfer Learning Approach to Enhance Deep Neural Network Classification of Brain Functional Connectomes

Simultaneous Spatial-Temporal Decomposition for Connectome-Scale Brain Networks by Deep Sparse Recurrent Auto-Encoder

Graph Autoencoders for Embedding Learning in Brain Networks and Major Depressive Disorder Identification

Learning brain representation using recurrent Wasserstein generative adversarial net

State-space model with deep learning for functional dynamics estimation in resting-state fMRI

Modeling Hierarchical Brain Networks Via Volumetric Sparse Deep Belief Network

BrainMAE: A Region-aware Self-supervised Learning Framework for Brain Signals

Mapping dynamic spatial patterns of brain function with spatial-wise attention