Abstract:Functional magnetic resonance imaging (fMRI) is a methodology for measuring human brain activities. It has become more and more popular in neural decoding due to its noninvasive. Neural decoding aims to establishing models to reconstruct external stimuli or features of stimuli from known brain responses, so that we can understand the principles of brain functions such as emotion, cognition and language. Neural decoding based on fMRI is of great significance for further understanding the mechanism of brain operation. Most existing studies take multi-scale topology information of brain networks obtained from fMRI into account in neural decoding. However, they always ignore the simultaneous modeling of network structure and hemodynamic response, thus leading to information loss. In addition, current multi-scale methods usually only utilize spatial or logical reasoning relationship of brain networks, which brings challenge to precise neural decoding. In this work, we present a novel and robust multi-scale spatial and logical reasoning learning framework (MSLR) for fMRI-based neural decoding. Specifically, we first design graph signal wavelet generation module to combine brain network topology and node information to construct multi-scale representation of brain networks in a local to global manner. Then, we develop multi-scale information fusion module that can simultaneously model the spatial and logical reasoning relationship of brain networks, it can also learn discriminative multi-scale features with brain state transition. Finally, we construct a neural decoding module to predict the brain states. We evaluated the framework on the public Human Connectome Project (HCP) dataset that included 986 participants. The experimental results with support vector machine (SVM) outperform current state-of-the-art methods on four evaluation metrics (accuracy: 91.58, kappa coefficient: 0.883, macro F1: 0.865 and hamming distance: 0.105) under 19 different stimuli spanning 7 different cognitive tasks. The interpretation of the learned multi-scale representation replicates neuroscientific findings from previous fMRI studies and renews the multi-scale information flow pattern of brain network in neural decoding.

Voxel Selection and Neural Decoding of Fmri Data Based on Robust Sparse Programming with Multi-Dimensional Derivative Constraints.

Balancing the Stability and Predictive Performance for Multivariate Voxel Selection in fMRI Study.

A Sparse Voxel Selection Approach for Fmri Data Analysis with Multi-Dimensional Derivative Constraints

Integration of Sparse Bayesian Learning and Random Subspace for Fmri Multivariate Pattern Analysis

Voxel selection in FMRI data analysis based on sparse representation.

Voxel selection in fMRI data analysis: A sparse representation method

Using multi-voxel pattern analysis of fMRI data to decoding human visual cortex activations

A Hybrid Spatiotemporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multilevel Core Functional Components in Decoding Multitask Fmri Signals.

A Hybrid Spatio-Temporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multi-Level Core Functional Components in Decoding Multi-Task fMRI Signals

A novel DRL-guided sparse voxel decoding model for reconstructing perceived images from brain activity

Improved Application of Sparse Representation Classifier in fMRI-based Brain State Decoding.

Voxel selection framework based on meta-heuristic search and mutual information for brain decoding

Grouped Sparse Bayesian Learning for Voxel Selection in Multivoxel Pattern Analysis of Fmri Data

Jointly Fusing Multi-Scale Spatial-Logical Brain Networks: A Neural Decoding Method

Improved Sparse Decomposition Based on a Smoothed L0 Norm Using a Laplacian Kernel to Select Features from Fmri Data

Robust Fiber Orientation Distribution Function Estimation Using Deep Constrained Spherical Deconvolution for Diffusion MRI

An Adaptively Weighted Averaging Method for Regional Time Series Extraction of fMRI-based Brain Decoding

Correntropy-Based Logistic Regression with Automatic Relevance Determination for Robust Sparse Brain Activity Decoding

Multi-subject brain decoding with multi-task feature selection.

Multi-Scale Spatio-Temporal Fusion with Adaptive Brain Topology Learning for Fmri Based Neural Decoding.

Feature-Specific Denoising of Neural Activity for Natural Image Identification