Abstract:Decoding specific task states from human fMRI (functional magnetic resonance imaging) signals constitutes a major goal of neuroimaging. Previous studies of task-state classification have focused largely on processed fMRI characteristics (e.g. functional connectivity patterns, activity patterns) or a single fMRI volume. Here, we assembled a novel deep neural network (DNN) for classifying directly from 4-D fMRI time series, retaining both spatial and temporal information of fMRI signals. We trained and tested the DNN classifier by task fMRI data from human connectome project (HCP) S1200 dataset. Reading just a single block of fMRI time series of each task for each individual, the novel classification method identified the seven tasks with 91.75% accuracy in test. Then we extracted task heatmaps of each time series by a guided backpropagation approach, and found that the heatmaps had a high similarity with the group average result of traditional contrast of parameter estimate (COPE). Furthermore, the DNN could be applied to small dataset. The features from the intermediate layer of the DNN were trained and used to train a support vector machine (SVM) to classify four conditions within 300 blocks of task-fMRI scans, data amount comparable to a usual neuroimaging research, and obtained a 95% accuracy. Our reported findings were the first to demonstrate the ability of DNN to classify and extract heatmaps from a 4-D fMRI time series, as well as its ability to be transfer trained by a small dataset. This approach should enable decoding and mapping subject's task status and furthermore help with classification and diagnosis of neuropsychiatric diseases.

Task Fmri Data Analysis Based on Supervised Stochastic Coordinate Coding.

Modeling Task FMRI Data via Supervised Stochastic Coordinate Coding.

Detecting Brain Activations by Constrained Non-Negative Matrix Factorization from Task-Related BOLD Fmri

Characterizing And Differentiating Task-Based And Resting State Fmri Signals Via Two-Stage Dictionary Learning

Supervised Dictionary Learning for Inferring Concurrent Brain Networks

Sparse representation of higher-order functional interaction patterns in task-based FMRI data.

Identifying functional networks via sparse coding of whole brain FMRI signals

Sparse Representation of Whole-Brain Fmri Signals for Identification of Functional Networks.

Sparse Representation of Group-Wise FMRI Signals

A Hybrid Spatio-Temporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multi-Level Core Functional Components in Decoding Multi-Task fMRI Signals

Characterizing task-evoked and intrinsic functional networks from task-based fMRI data via two-stage sparse dictionary learning

FMRI Data Classification Based on Hybrid Temporal and Spatial Sparse Representation

Characterizing and differentiating task-based and resting state fMRI signals via two-stage sparse representations

Exploring intrinsic networks and their interactions using group wise temporal sparse coding

Task State Decoding and Mapping of Individual Four-Dimensional Fmri Time Series Using Deep Neural Network

Supervised Brain Network Learning Based on Deep Recurrent Neural Networks.

Exploring Human Brain Activation Via Nested Sparse Coding And Functional Operators

Modeling Task Fmri Data Via Deep Convolutional Autoencoder

Extendable supervised dictionary learning for exploring diverse and concurrent brain activities in task-based fMRI

A Task Performance-guided Model of Functional Networks Identification

A Joint Analysis of Multi-Paradigm fMRI Data With Its Application to Cognitive Study