Abstract:Multimodal functional neuroimaging by integrating functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) has the promise of recovering brain activities with high spatiotemporal resolution, which is crucial for neuroscience research and clinical diagnosis. However, the misalignment of the localizations between fMRI and EEG activities may degrade the accuracy of the fMRI-constrained EEG source imaging (ESI) technique. To leverage the complementary spatiotemporal resolution of fMRI and EEG in a data-driven fashion, we propose an asymmetric approach for EEG/fMRI fusion, termed fMRI-informed source imaging based on spatiotemporal basis functions (fMRI-SI-STBF). fMRI-SI-STBF employs the covariance components (CCs) derived from clusters defined by fMRI and EEG signals as spatial priors within the empirical Bayesian framework. Additionally, fMRI-SI-STBF represents the current source matrix as a linear combination of several unknown temporal basis functions (TBFs) by matrix decomposition. The relative contribution of each of the fMRI-informed and EEG-informed CCs, as well as the number and profiles of the TBFs, are all automatically determined based on the EEG data using variational Bayesian inference. Our results demonstrate that fMRI-SI-STBF can effectively utilize valid fMRI information for ESI and is robust to invalid fMRI priors. This robustness is essential for practical ESI since the validity of fMRI priors is often unclear considering that fMRI is an indirect measure of neural activity. Moreover, fMRI-SI-STBF can achieve performance improvement by incorporating temporal constraints compared to methods that use spatial constraints only. For the numerical simulations, fMRI-SI-STBF reconstructs the source extents, locations and time courses more accurately than existing EEG-fMRI ESI methods (i.e., fwMNE, fMRI-SI-SBF) and ESI methods without fMRI priors (i.e., wMNE, LORETA, SBL, SI-STBF, SI-SBF), indicated by the smaller spatial dispersion (average SD <math><5</math> mm), distance of localization error (average DLE <math><2</math> mm), shape error (average SE <math><0.9</math>) and larger model evidence values.

EEG Source Localization Based on Multiple fMRI Spatial Patterns

EEG source localization using a sparsity prior based on Brodmann areas

fMRI-SI-STBF: An fMRI-informed Bayesian electromagnetic spatio-temporal extended source imaging

Ica Based Multiple Brain Sources Localization

EEG Source Imaging Based on fMRI Functional Network and Bayesian Matrix Decomposition

Cortical Surface Alignment in Multi-Subject Spatiotemporal Independent EEG Source Imaging

A New Fmri Informed Mixed-Norm Constrained Algorithm for EEG Source Localization.

Fmri Functional Networks for EEG Source Imaging

EEG/MEG Source Imaging Using Fmri Informed Time-Variant Constraints

Blind Source Separation By Ica For Eeg Multiple Sources Localization

Incorporating Priors for EEG Source Imaging and Connectivity Analysis

EEG Source Localization Using Independent Residual Analysis.

Coherent sources mapping by K-means cluster and correlation coefficient

Deep EEG source localization via EMD-based fMRI high spatial frequency

A Novel EEG Source Localization Method Based on FOCUSS Iteration Procedure Combined with Lp Norm Sparse Constraints

[The Improved FOCUSS Combined with the Fmri Priors for EEG Source Localization and Its Preliminary Application].

Incorporating FMRI Functional Networks in EEG Source Imaging: a Bayesian Model Comparison Approach.

Equivalent Charge Source Model Based Iterative Maximum Neighbor Weight for Sparse EEG Source Localization

Electromagnetic Brain Imaging Based on Standardized Resting-State Networks

Bayesian Electromagnetic Spatio-Temporal Imaging of Extended Sources with Markov Random Field and Temporal Basis Expansion

EEG Source Localization Using Spatio-Temporal Neural Network