Abstract:Multimodal functional neuroimaging by integrating functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) has the promise of recovering brain activities with high spatiotemporal resolution, which is crucial for neuroscience research and clinical diagnosis. However, the misalignment of the localizations between fMRI and EEG activities may degrade the accuracy of the fMRI-constrained EEG source imaging (ESI) technique. To leverage the complementary spatiotemporal resolution of fMRI and EEG in a data-driven fashion, we propose an asymmetric approach for EEG/fMRI fusion, termed fMRI-informed source imaging based on spatiotemporal basis functions (fMRI-SI-STBF). fMRI-SI-STBF employs the covariance components (CCs) derived from clusters defined by fMRI and EEG signals as spatial priors within the empirical Bayesian framework. Additionally, fMRI-SI-STBF represents the current source matrix as a linear combination of several unknown temporal basis functions (TBFs) by matrix decomposition. The relative contribution of each of the fMRI-informed and EEG-informed CCs, as well as the number and profiles of the TBFs, are all automatically determined based on the EEG data using variational Bayesian inference. Our results demonstrate that fMRI-SI-STBF can effectively utilize valid fMRI information for ESI and is robust to invalid fMRI priors. This robustness is essential for practical ESI since the validity of fMRI priors is often unclear considering that fMRI is an indirect measure of neural activity. Moreover, fMRI-SI-STBF can achieve performance improvement by incorporating temporal constraints compared to methods that use spatial constraints only. For the numerical simulations, fMRI-SI-STBF reconstructs the source extents, locations and time courses more accurately than existing EEG-fMRI ESI methods (i.e., fwMNE, fMRI-SI-SBF) and ESI methods without fMRI priors (i.e., wMNE, LORETA, SBL, SI-STBF, SI-SBF), indicated by the smaller spatial dispersion (average SD <math><5</math> mm), distance of localization error (average DLE <math><2</math> mm), shape error (average SE <math><0.9</math>) and larger model evidence values.

EEG Extended Source Imaging with Structured Sparsity and L_1 -Norm Residual

Lp Norm Iterative Sparse Solution for EEG Source Localization

Sparse EEG Source Localization Using LAPPS: Least Absolute L-P (0<p<1) Penalized Solution.

Imaging Brain Extended Sources from EEG/MEG Based on Variation Sparsity Using Automatic Relevance Determination

WRA-MTSI: A Robust Extended Source Imaging Algorithm Based on Multi-Trial EEG

VSSI-GGD: A Variation Sparse EEG Source Imaging Approach Based on Generalized Gaussian Distribution

Debiased Estimation and Inference for Spatial-Temporal EEG/MEG Source Imaging

The iterative reweighted Mixed-Norm Estimate for spatio-temporal MEG/EEG source reconstruction

SISSY: An efficient and automatic algorithm for the analysis of EEG sources based on structured sparsity

A Long Short-Term Memory Network for Sparse Spatiotemporal EEG Source Imaging

A Novel EEG Source Localization Method Based on FOCUSS Iteration Procedure Combined with Lp Norm Sparse Constraints

Source Imaging Method based on Spatial Smoothing and Edge Sparsity (SISSES) and Its Application to OPM-MEG

Probabilistic Structure Learning for EEG/MEG Source Imaging With Hierarchical Graph Priors

fMRI-SI-STBF: An fMRI-informed Bayesian electromagnetic spatio-temporal extended source imaging

Probabilistic Structure Learning for EEG/MEG Source Imaging with Hierarchical Graph Prior

Electromagnetic Source Imaging With a Combination of Sparse Bayesian Learning and Deep Neural Network

Accelerated High-Resolution EEG Source Imaging

STRAPS: A Fully Data-Driven Spatio-Temporally Regularized Algorithm for M/EEG Patch Source Imaging.

EEG Source Localization Using Spatio-Temporal Neural Network

Improvement in EEG Source Imaging Accuracy by Means of Wavelet Packet Transform and Subspace Component Selection

Variation Sparse Source Imaging Based on Conditional Mean for Electromagnetic Extended Sources