Abstract:It has been recently shown that deep learning models such as convolutional neural networks (CNN), deep belief networks (DBN) and recurrent neural networks (RNN), exhibited remarkable ability in modeling and representing fMRI data for the understanding of functional activities and networks because of their superior data representation capability and wide availability of effective deep learning tools. For example, spatial and/or temporal patterns of functional brain activities embedded in fMRI data can be effectively characterized and modeled by a variety of CNN/DBN/RNN deep learning models as shown in recent studies. However, it has been rarely investigated whether it is possible to directly infer hierarchical brain networks from volumetric fMRI data using deep learning models such as DBN. The perceived difficulties of such studies include very large number of input variables, very large number of training parameters, the lack of effective software tools, the challenge of results interpretation, and etc. To bridge these technical gaps, we designed a novel volumetric sparse deep belief network (VS-DBN) model and implemented it through the popular TensorFlow open source platform to reconstruct hierarchical brain networks from volumetric fMRI data based on the Human Connectome Project (HCP) 900 subjects release. Our experimental results showed that a large number of interpretable and meaningful brain networks can be robustly reconstructed from HCP 900 subjects in a hierarchical fashion, and importantly, these brain networks exhibit reasonably good consistency and correspondence across multiple HCP task-based fMRI datasets. Our work contributed a new general deep learning framework for inferring multiscale volumetric brain networks and offered novel insights into the hierarchical organization of functional brain architecture.

3d Convolutional Long-Short Term Memory Network For Spatiotemporal Modeling Of Fmri Data

Modeling 4D fMRI Data via Spatio-Temporal Convolutional Neural Networks (ST-CNN)

A Guided Attention 4D Convolutional Neural Network for Modeling Spatio-Temporal Patterns of Functional Brain Networks.

Modeling Task Fmri Data Via Deep Convolutional Autoencoder

A Multichannel 2D Convolutional Neural Network Model for Task-Evoked fMRI Data Classification

Spatial-Temporal Convolutional Attention for Mapping Functional Brain Networks.

Spatial-Temporal Dependency Modeling and Network Hub Detection for Functional MRI Analysis via Convolutional-Recurrent Network

Hierarchical Spatio-Temporal State-Space Modeling for fMRI Analysis

3D Convolutional Neural Networks for Classification of Functional Connectomes

A Hybrid Spatio-Temporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multi-Level Core Functional Components in Decoding Multi-Task fMRI Signals

Convolutional Recurrent Neural Network for Dynamic Functional MRI Analysis and Brain Disease Identification

Characterizing Functional Brain Networks Via Spatio-Temporal Attention 4D Convolutional Neural Networks (Sta-4Dcnns)

Automatic Recognition of fMRI-derived Functional Networks using 3D Convolutional Neural Networks.

Simultaneous Spatial-Temporal Decomposition for Connectome-Scale Brain Networks by Deep Sparse Recurrent Auto-Encoder

A Hybrid 3DCNN and 3DC-LSTM based model for 4D Spatio-temporal fMRI data: An ABIDE Autism Classification study

Spatio-Temporal Graph Convolution for Resting-State fMRI Analysis

Exploring Brain Effective Connectivity Networks Through Spatiotemporal Graph Convolutional Models.

Modeling Hierarchical Brain Networks Via Volumetric Sparse Deep Belief Network

A 3D Spatially Weighted Network for Segmentation of Brain Tissue from MRI

Generalized Recurrent Neural Network accommodating Dynamic Causal Modeling for functional MRI analysis

3D Global Fourier Network for Alzheimer's Disease Diagnosis Using Structural MRI