Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Background</h3><p>Deep neural networks have revolutionised machine learning, with unparalleled performance in object classification. However, in brain imaging (<em>e.g.</em>, fMRI), the direct application of Convolutional Neural Networks (CNN) to decoding subject states or perception from imaging data seems impractical given the scarcity of available data.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">New method</h3><p>In this work we propose a robust method to transfer information from deep learning (DL) features to brain fMRI data with the goal of decoding. By adopting Reduced Rank Regression with Ridge Regularisation we establish a multivariate link between imaging data and the fully connected layer (<span class="monospace">fc7</span>) of a CNN. We exploit the reconstructed <span class="monospace">fc7</span> features by performing an object image classification task on two datasets: one of the largest fMRI databases, taken from different scanners from more than two hundred subjects watching different movie clips, and another with fMRI data taken while watching static images.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>The <span class="monospace">fc7</span> features could be significantly reconstructed from the imaging data, and led to significant decoding performance.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Comparison with existing methods</h3><p>The decoding based on reconstructed <span class="monospace">fc7</span> outperformed the decoding based on imaging data alone.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusion</h3><p>In this work we show how to improve fMRI-based decoding benefiting from the mapping between functional data and CNN features. The potential advantage of the proposed method is twofold: the extraction of stimuli representations by means of an automatic procedure (unsupervised) and the embedding of high-dimensional neuroimaging data onto a space designed for visual object discrimination, leading to a more manageable space from dimensionality point of view.</p>

Distributed rank-1 dictionary learning: Towards fast and scalable solutions for fMRI big data analytics

Fast and Scalable Distributed Deep Convolutional Autoencoder for fMRI Big Data Analytics

Supervised Dictionary Learning for Inferring Concurrent Brain Networks

Deep sr-DDL: Deep structurally regularized dynamic dictionary learning to integrate multimodal and dynamic functional connectomics data for multidimensional clinical characterizations

A Hybrid Spatio-Temporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multi-Level Core Functional Components in Decoding Multi-Task fMRI Signals

Deep Factor Learning for Accurate Brain Neuroimaging Data Analysis on Discrimination for Structural MRI and Functional MRI

Robust Subject-Wise Dictionary Learning for fMRI

Deep learning of fMRI big data: a novel approach to subject-transfer decoding

Large-Scale Functional Connectome Fingerprinting for Generalization and Transfer Learning in Neuroimaging

Dictionary Learning for Massive Matrix Factorization

Sparse Deep Neural Network for Encoding and Decoding the Structural Connectome

Evaluation of Task fMRI Decoding With Deep Learning on a Small Sample Dataset

Task State Decoding and Mapping of Individual Four-Dimensional Fmri Time Series Using Deep Neural Network

Cerebellar Functional Parcellation Using Sparse Dictionary Learning Clustering.

Three layered sparse dictionary learning algorithm for enhancing the subject wise segregation of brain networks

Transfer learning of deep neural network representations for fMRI decoding

Supervised Brain Network Learning Based on Deep Recurrent Neural Networks.

Online dictionary learning based on subject connectivity in fMRI data

An Adaptively Weighted Averaging Method for Regional Time Series Extraction of fMRI-based Brain Decoding

Efficient Federated Learning for distributed NeuroImaging Data

Identifying functional networks via sparse coding of whole brain FMRI signals