Abstract:Multimodal functional neuroimaging by integrating functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) has the promise of recovering brain activities with high spatiotemporal resolution, which is crucial for neuroscience research and clinical diagnosis. However, the misalignment of the localizations between fMRI and EEG activities may degrade the accuracy of the fMRI-constrained EEG source imaging (ESI) technique. To leverage the complementary spatiotemporal resolution of fMRI and EEG in a data-driven fashion, we propose an asymmetric approach for EEG/fMRI fusion, termed fMRI-informed source imaging based on spatiotemporal basis functions (fMRI-SI-STBF). fMRI-SI-STBF employs the covariance components (CCs) derived from clusters defined by fMRI and EEG signals as spatial priors within the empirical Bayesian framework. Additionally, fMRI-SI-STBF represents the current source matrix as a linear combination of several unknown temporal basis functions (TBFs) by matrix decomposition. The relative contribution of each of the fMRI-informed and EEG-informed CCs, as well as the number and profiles of the TBFs, are all automatically determined based on the EEG data using variational Bayesian inference. Our results demonstrate that fMRI-SI-STBF can effectively utilize valid fMRI information for ESI and is robust to invalid fMRI priors. This robustness is essential for practical ESI since the validity of fMRI priors is often unclear considering that fMRI is an indirect measure of neural activity. Moreover, fMRI-SI-STBF can achieve performance improvement by incorporating temporal constraints compared to methods that use spatial constraints only. For the numerical simulations, fMRI-SI-STBF reconstructs the source extents, locations and time courses more accurately than existing EEG-fMRI ESI methods (i.e., fwMNE, fMRI-SI-SBF) and ESI methods without fMRI priors (i.e., wMNE, LORETA, SBL, SI-STBF, SI-SBF), indicated by the smaller spatial dispersion (average SD <math><5</math> mm), distance of localization error (average DLE <math><2</math> mm), shape error (average SE <math><0.9</math>) and larger model evidence values.

SNAKE-fMRI: A modular fMRI data simulator from the space-time domain to k-space and back

SNAKE-fMRI: A modular fMRI data simulator from the space-time domain to k-space and back

Three-dimensional spatially resolved phase graph framework

A 3D k-space Fourier encoding and reconstruction framework for simultaneous multi-slab acquisition.

BOLDsωimsuite: A new software suite for forward modeling of the BOLD fMRI signal

TEAM PILOT -- Learned Feasible Extendable Set of Dynamic MRI Acquisition Trajectories

Brain3D: Generating 3D Objects from fMRI

fMRI-3D: A Comprehensive Dataset for Enhancing fMRI-based 3D Reconstruction

fMRI-SI-STBF: An fMRI-informed Bayesian electromagnetic spatio-temporal extended source imaging

An In-depth Exploration of the Interplay between fMRI Methods and Theory in Cognitive Neuroscience

PhoenixMR: A GPU-based MRI simulation framework with runtime-dynamic code execution

BrainIAK: The Brain Imaging Analysis Kit

A working hypothesis visualization method for fNIRS measurements using Monte Carlo simulation

Pushing functional MRI spatial and temporal resolution further: High‐density receive arrays combined with shot‐selective 2D CAIPIRINHA for 3D echo‐planar imaging at 7 T

MambaRecon: MRI Reconstruction with Structured State Space Models

Nonlinear Deconvolution by Sampling Biophysically Plausible Hemodynamic Models

Mri Reconstruction from 2d Truncated K-Space

CMRsim–A python package for cardiovascular MR simulations incorporating complex motion and flow

Hierarchical Spatio-Temporal State-Space Modeling for fMRI Analysis

Global k-Space Interpolation for Dynamic MRI Reconstruction using Masked Image Modeling

Portable simulation framework for diffusion MRI