Abstract:Multimodal functional neuroimaging by integrating functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) has the promise of recovering brain activities with high spatiotemporal resolution, which is crucial for neuroscience research and clinical diagnosis. However, the misalignment of the localizations between fMRI and EEG activities may degrade the accuracy of the fMRI-constrained EEG source imaging (ESI) technique. To leverage the complementary spatiotemporal resolution of fMRI and EEG in a data-driven fashion, we propose an asymmetric approach for EEG/fMRI fusion, termed fMRI-informed source imaging based on spatiotemporal basis functions (fMRI-SI-STBF). fMRI-SI-STBF employs the covariance components (CCs) derived from clusters defined by fMRI and EEG signals as spatial priors within the empirical Bayesian framework. Additionally, fMRI-SI-STBF represents the current source matrix as a linear combination of several unknown temporal basis functions (TBFs) by matrix decomposition. The relative contribution of each of the fMRI-informed and EEG-informed CCs, as well as the number and profiles of the TBFs, are all automatically determined based on the EEG data using variational Bayesian inference. Our results demonstrate that fMRI-SI-STBF can effectively utilize valid fMRI information for ESI and is robust to invalid fMRI priors. This robustness is essential for practical ESI since the validity of fMRI priors is often unclear considering that fMRI is an indirect measure of neural activity. Moreover, fMRI-SI-STBF can achieve performance improvement by incorporating temporal constraints compared to methods that use spatial constraints only. For the numerical simulations, fMRI-SI-STBF reconstructs the source extents, locations and time courses more accurately than existing EEG-fMRI ESI methods (i.e., fwMNE, fMRI-SI-SBF) and ESI methods without fMRI priors (i.e., wMNE, LORETA, SBL, SI-STBF, SI-SBF), indicated by the smaller spatial dispersion (average SD <math><5</math> mm), distance of localization error (average DLE <math><2</math> mm), shape error (average SE <math><0.9</math>) and larger model evidence values.

Model-free Region of Interest Based Analysis of Fmri Data

Region of interest based independent component analysis

Clustering Analysis for Fmri Dataset Based on ISODATA Algorithm

[Blind source separation for fMRI signals using a new independent component analysis algorithm and principal component analysis]

Probabilistic Source Separation on Resting-State fMRI and Its Use for Early MCI Identification

A Toolbox for Model-Free Analysis of Fmri Data

Latent Source Mining in FMRI Via Restricted Boltzmann Machine

A practical model-based segmentation approach for improved activation detection in single-subject functional Magnetic Resonance Imaging studies

Analysis of fMRI data by blind separation of data in a tiny spatial domain into independent temporal component

Source density-driven independent component analysis approach for fMRI data

LATENT SOURCE MINING OF FMRI DATA VIA DEEP BELIEF NETWORK

ICA, Kernel Methods and Nonnegativity: New Paradigms for Dynamical Component Analysis of Fmri Data

Selection of a Model of Cerebral Activity for fMRI Group Data Analysis

An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets

EEG-fMRI: Ballistocardiogram Artifact Reduction by Surrogate Method for Improved Source Localization

Segment anything model (SAM) for brain extraction in fMRI studies

Automated Skull Stripping in Mouse Functional Magnetic Resonance Imaging Analysis Using 3D U-Net

Functional brain segmentation using inter-subject correlation in fMRI

fMRI-SI-STBF: An fMRI-informed Bayesian electromagnetic spatio-temporal extended source imaging

Joint, Partially-joint, and Individual Independent Component Analysis in Multi-Subject fMRI Data

Joint Blind Source Separation for Neurophysiological Data Analysis: Multiset and Multimodal Methods