Abstract:Objective. Recently, deep learning models have been successfully applied in functional magnetic resonance imaging (fMRI) modeling and associated applications. However, there still exist at least two challenges. Firstly, due to the lack of sufficient data, deep learning models tend to suffer from overfitting in the training process. Secondly, it is still challenging to model the temporal dynamics from fMRI, due to that the brain state is continuously changing over scan time. In addition, existing methods rarely studied and applied fMRI data augmentation.Approach. In this work, we construct a deep recurrent variational auto-encoder (DRVAE) that combined variational auto-encoder and recurrent neural network, aiming to address all of the above mentioned challenges. The encoder of DRVAE can extract more generalized temporal features from assumed Gaussian distribution of input data, and the decoder of DRVAE can generate new data to increase training samples and thus partially relieve the overfitting issue. The recurrent layers in DRVAE are designed to effectively model the temporal dynamics of functional brain activities. LASSO (least absolute shrinkage and selection operator) regression is applied on the temporal features and input fMRI data to estimate the corresponding spatial networks.Main results. Extensive experimental results on seven tasks from HCP dataset showed that the DRVAE and LASSO framework can learn meaningful temporal patterns and spatial networks from both real data and generated data. The results on group-wise data and single subject suggest that the brain activities may follow certain distribution. Moreover, we applied DRVAE on four resting state fMRI datasets from ADHD-200 for data augmentation, and the results showed that the classification performances on augmented datasets have been considerably improved.Significance. The proposed method can not only derive meaningful temporal features and spatial networks from fMRI, but also generate high-quality new data for fMRI data augmentation and associated applications.

Modeling Task Fmri Data Via Deep Convolutional Autoencoder

Fast and Scalable Distributed Deep Convolutional Autoencoder for fMRI Big Data Analytics

MODELING TASK FMRI DATA VIA MIXTURE OF DEEP EXPERT NETWORKS

Exploring Brain Hemodynamic Response Patterns Via Deep Recurrent Autoencoder

Constructing Fine-Granularity Functional Brain Network Atlases Via Deep Convolutional Autoencoder.

Simultaneous Spatial-Temporal Decomposition for Connectome-Scale Brain Networks by Deep Sparse Recurrent Auto-Encoder

Deep Variational Autoencoder for Mapping Functional Brain Networks

3d Convolutional Long-Short Term Memory Network For Spatiotemporal Modeling Of Fmri Data

Design of Deep Learning Model for Task-Evoked fMRI Data Classification

Modeling and augmenting of fMRI data using deep recurrent variational auto-encoder

Modeling Task FMRI Data via Supervised Stochastic Coordinate Coding.

Modeling Hierarchical Brain Networks Via Volumetric Sparse Deep Belief Network

Hierarchical Spatio-Temporal State-Space Modeling for fMRI Analysis

Modeling 4D fMRI Data via Spatio-Temporal Convolutional Neural Networks (ST-CNN)

A Hybrid Spatio-Temporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multi-Level Core Functional Components in Decoding Multi-Task fMRI Signals

Identify Hierarchical Structures from Task-Based fMRI Data via Hybrid Spatiotemporal Neural Architecture Search Net

Task Fmri Data Analysis Based on Supervised Stochastic Coordinate Coding.

Explore The Hierarchical Auditory Information Processing Via Deep Convolutional Autoencoder

Embedding Human Brain Function via Transformer

The Unsupervised Hierarchical Convolutional Sparse Auto-Encoder for Neuroimaging Data Classification

Brain Decoding Using Deep Convolutional Network and Its Application in Cross-Subject Analysis.