Abstract:It has been recently shown that deep learning models such as convolutional neural networks (CNN), deep belief networks (DBN) and recurrent neural networks (RNN), exhibited remarkable ability in modeling and representing fMRI data for the understanding of functional activities and networks because of their superior data representation capability and wide availability of effective deep learning tools. For example, spatial and/or temporal patterns of functional brain activities embedded in fMRI data can be effectively characterized and modeled by a variety of CNN/DBN/RNN deep learning models as shown in recent studies. However, it has been rarely investigated whether it is possible to directly infer hierarchical brain networks from volumetric fMRI data using deep learning models such as DBN. The perceived difficulties of such studies include very large number of input variables, very large number of training parameters, the lack of effective software tools, the challenge of results interpretation, and etc. To bridge these technical gaps, we designed a novel volumetric sparse deep belief network (VS-DBN) model and implemented it through the popular TensorFlow open source platform to reconstruct hierarchical brain networks from volumetric fMRI data based on the Human Connectome Project (HCP) 900 subjects release. Our experimental results showed that a large number of interpretable and meaningful brain networks can be robustly reconstructed from HCP 900 subjects in a hierarchical fashion, and importantly, these brain networks exhibit reasonably good consistency and correspondence across multiple HCP task-based fMRI datasets. Our work contributed a new general deep learning framework for inferring multiscale volumetric brain networks and offered novel insights into the hierarchical organization of functional brain architecture.

Modeling task-based fMRI data via deep belief network with neural architecture search

Neural Architecture Search for Optimizing Deep Belief Network Models of Fmri Data

Hierarchical Spatio-Temporal Modeling of Naturalistic Functional Magnetic Resonance Imaging Signals Via Two-Stage Deep Belief Network with Neural Architecture Search

Modeling Hierarchical Spatial and Temporal Patterns of Naturalistic Fmri Volume Via Volumetric Deep Belief Network with Neural Architecture Search.

Hierarchical Individual Naturalistic Functional Brain Networks with Group Consistency Uncovered by a Two-Stage NAS-Volumetric Sparse DBN Framework

Identifying Hierarchical Individual Functional Network under Naturalistic Paradigm Via Two-stage DBN with Neural Architecture Search.

Gumbel-Softmax Based Neural Architecture Search for Hierarchical Brain Networks Decomposition

Identify Hierarchical Structures from Task-Based fMRI Data via Hybrid Spatiotemporal Neural Architecture Search Net

Modeling Hierarchical Brain Networks Via Volumetric Sparse Deep Belief Network

Hierarchical Brain Networks Decomposition via Prior Knowledge Guided Deep Belief Network

A Two-Stage DBN-Based Method to Exploring Functional Brain Networks in Naturalistic Paradigm FMRI.

Modeling Task Fmri Data Via Deep Convolutional Autoencoder

Prediction of dMRI signals with neural architecture search

Modeling Functional Brain Networks for ADHD via Spatial Preservation-based Neural Architecture Search

LATENT SOURCE MINING OF FMRI DATA VIA DEEP BELIEF NETWORK

Neural Architecture Search for Optimization of Spatial-Temporal Brain Network Decomposition

Evolutional Neural Architecture Search for Optimization of Spatiotemporal Brain Network Decomposition.

DEEP DAG LEARNING OF EFFECTIVE BRAIN CONNECTIVITY FOR FMRI ANALYSIS

Learning Task-Aware Effective Brain Connectivity for fMRI Analysis with Graph Neural Networks

FBNETGEN: Task-aware GNN-based fMRI Analysis via Functional Brain Network Generation

Identifying Autism Spectrum Disorder From Resting-State fMRI Using Deep Belief Network