Abstract:Early diagnosis remains a significant challenge for many neurological disorders, especially for rare disorders where studying large cohorts is not possible. A novel solution that investigators have undertaken is combining advanced machine learning algorithms with resting-state functional Magnetic Resonance Imaging to unveil hidden pathological brain connectome patterns to uncover diagnostic and prognostic biomarkers. Recently, state-of-the-art deep learning techniques are outperforming traditional machine learning methods and are hailed as a milestone for artificial intelligence. However, whole brain classification that combines brain connectome with deep learning has been hindered by insufficient training samples. Inspired by the transfer learning strategy employed in computer vision, we exploited previously collected resting-state functional MRI data for healthy subjects from existing databases and transferred this knowledge for new disease classification tasks. We developed a deep transfer learning neural network (DTL-NN) framework for enhancing the classification of whole brain functional connectivity patterns. Briefly, we trained a stacked sparse autoencoder (SSAE) prototype to learn healthy functional connectivity patterns in an offline learning environment. Then, the SSAE prototype was transferred to a DTL-NN model for a new classification task. To test the validity of our framework, we collected resting-state functional MRI data from the Autism Brain Imaging Data Exchange (ABIDE) repository. Using autism spectrum disorder (ASD) classification as a target task, we compared the performance of our DTL-NN approach with a traditional deep neural network and support vector machine models across four ABIDE data sites that enrolled at least 60 subjects. As compared to traditional models, our DTL-NN approach achieved an improved performance in accuracy, sensitivity, specificity and area under receiver operating characteristic curve. These findings suggest that DTL-NN approaches could enhance disease classification for neurological conditions, where accumulating large neuroimaging datasets has been challenging.

Evaluating deep transfer learning for whole-brain cognitive decoding

Challenges for cognitive decoding using deep learning methods

Decoding Behavior Tasks From Brain Activity Using Deep Transfer Learning

Transfer learning of deep neural network representations for fMRI decoding

Evaluating the structure of cognitive tasks with transfer learning

Deep learning of fMRI big data: a novel approach to subject-transfer decoding

Transfer Learning-Based Behavioural Task Decoding from Brain Activity

Brain Decoding Using Deep Convolutional Network and Its Application in Cross-Subject Analysis.

Cross-paradigm pretraining of convolutional networks improves intracranial EEG decoding

Application of Transfer Learning in EEG Decoding Based on Brain-Computer Interfaces: A Review

Transfer learning to decode brain states reflecting the relationship between cognitive tasks

Evaluation of Task fMRI Decoding With Deep Learning on a Small Sample Dataset

Pre-training Deep Neural Network for Decoding Multiple Brain Regions Can Enhance Image Reconstruction

Deep learning approaches for neural decoding across architectures and recording modalities

A Hybrid Spatio-Temporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multi-Level Core Functional Components in Decoding Multi-Task fMRI Signals

Deep learning approaches for neural decoding: from CNNs to LSTMs and spikes to fMRI

A Hybrid Spatiotemporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multilevel Core Functional Components in Decoding Multitask Fmri Signals.

Transfer Learning with Large-Scale Data in Brain-Computer Interfaces.

Comparing interpretation methods in mental state decoding analyses with deep learning models

Attention module improves both performance and interpretability of four‐dimensional functional magnetic resonance imaging decoding neural network

A Novel Transfer Learning Approach to Enhance Deep Neural Network Classification of Brain Functional Connectomes