Abstract:Multimodal functional neuroimaging by integrating functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) has the promise of recovering brain activities with high spatiotemporal resolution, which is crucial for neuroscience research and clinical diagnosis. However, the misalignment of the localizations between fMRI and EEG activities may degrade the accuracy of the fMRI-constrained EEG source imaging (ESI) technique. To leverage the complementary spatiotemporal resolution of fMRI and EEG in a data-driven fashion, we propose an asymmetric approach for EEG/fMRI fusion, termed fMRI-informed source imaging based on spatiotemporal basis functions (fMRI-SI-STBF). fMRI-SI-STBF employs the covariance components (CCs) derived from clusters defined by fMRI and EEG signals as spatial priors within the empirical Bayesian framework. Additionally, fMRI-SI-STBF represents the current source matrix as a linear combination of several unknown temporal basis functions (TBFs) by matrix decomposition. The relative contribution of each of the fMRI-informed and EEG-informed CCs, as well as the number and profiles of the TBFs, are all automatically determined based on the EEG data using variational Bayesian inference. Our results demonstrate that fMRI-SI-STBF can effectively utilize valid fMRI information for ESI and is robust to invalid fMRI priors. This robustness is essential for practical ESI since the validity of fMRI priors is often unclear considering that fMRI is an indirect measure of neural activity. Moreover, fMRI-SI-STBF can achieve performance improvement by incorporating temporal constraints compared to methods that use spatial constraints only. For the numerical simulations, fMRI-SI-STBF reconstructs the source extents, locations and time courses more accurately than existing EEG-fMRI ESI methods (i.e., fwMNE, fMRI-SI-SBF) and ESI methods without fMRI priors (i.e., wMNE, LORETA, SBL, SI-STBF, SI-SBF), indicated by the smaller spatial dispersion (average SD <math><5</math> mm), distance of localization error (average DLE <math><2</math> mm), shape error (average SE <math><0.9</math>) and larger model evidence values.

LATENT SOURCE MINING OF FMRI DATA VIA DEEP BELIEF NETWORK

Latent Source Mining in FMRI Via Restricted Boltzmann Machine

A Two-Stage DBN-Based Method to Exploring Functional Brain Networks in Naturalistic Paradigm FMRI.

Bayesian Blind Source Separation for Data with Network Structure

Blind Source Separation of Functional MRI Scans of the Human Brain Based on Canonical Correlation Analysis

Electromagnetic Source Imaging With a Combination of Sparse Bayesian Learning and Deep Neural Network

Hierarchical Spatio-Temporal Modeling of Naturalistic Functional Magnetic Resonance Imaging Signals Via Two-Stage Deep Belief Network with Neural Architecture Search

Modeling task-based fMRI data via deep belief network with neural architecture search

Analysis of fMRI data based on sparsity of source components in signal dictionary.

Identifying Autism Spectrum Disorder From Resting-State fMRI Using Deep Belief Network

A Hybrid Spatiotemporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multilevel Core Functional Components in Decoding Multitask Fmri Signals.

An Improved Group BSS-CCA Method for Blind Source Separation of Functional MRI Scans of the Human Brain

Exploiting Asymmetric EEG Signals with EFD in Deep Learning Domain for Robust BCI

Modeling Hierarchical Spatial and Temporal Patterns of Naturalistic Fmri Volume Via Volumetric Deep Belief Network with Neural Architecture Search.

A Hybrid Spatio-Temporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multi-Level Core Functional Components in Decoding Multi-Task fMRI Signals

fMRI-SI-STBF: An fMRI-informed Bayesian electromagnetic spatio-temporal extended source imaging

Modeling Hierarchical Brain Networks Via Volumetric Sparse Deep Belief Network

Improved EEG Analysis Models and Methods Using Blind Source Separation

Bayesian Electromagnetic Spatio-Temporal Imaging of Extended Sources Based on Matrix Factorization.

Hierarchical Individual Naturalistic Functional Brain Networks with Group Consistency Uncovered by a Two-Stage NAS-Volumetric Sparse DBN Framework

A Robust Multi-Subject Fmri Analysis Method Using Dimensional Optimization