Abstract:Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are the two most commonlyusednon-invasive methods for studying brain function, having different but complementary strengths: high temporal resolution of the former and high spatial resolution of the latter. Crucially, fMRI is vital for studying subcortical areas, as those are practically out of reach for conventional EEG. At the same time, EEG is cost-effective and, thus, often preferable to fMRI if comparable information could be extracted which is not the case then the deep subcortical brain activity is of interest. Here we explore the possibility of recovering subcortical hemodynamics from the non-invasively recorded scalp EEG signals. To this end, we have developed a lightweight EEG-to-fMRI neural network and using an extended and publicly available dataset with concurrently recorded EEG-fMRI data show that our model allows for the prediction of the detailed Blood Oxygenation Level Dependent (BOLD) activity of 7 bilaterally symmetric subcortical structures solely from multichannel EEG data. We report the performance significantly above chance and exceeding the scores achieved for a single subcortical structure and obtained on the proprietary datasets. In contrast to the studies focusing on a single subcortical region in our approach we were able to decode multichannel EEG into 14 + 4 region-specific variations of BOLD signals measured relative to their mean hemodynamic activity. The use of relative BOLD signals allowed us to exert control over the artificial inflation of decoding accuracy scores when the decoder predicts the common mode component that is likely to have a non-neuronal origin (heartbeat, movement, etc). Finally, we interpreted our model. The electrical activity of the sensorimotor cortex appeared to contribute most to the prediction of the subcortical hemodynamics. Also, the hemodynamics of the thalamus has the smallest delay with respect to the EEG signals. Both observations are physiologically plausible and ensure the potential reliability of the decoder. Taken together, these findings pave the road towards the creation of low-cost AI-powered EEG-based fMRI digital twin technology capable of tracking subcortical activity in an ecological setting. The technology, once mature, will find numerous applications from fundamental neuroscience through diagnostics to neurorehabilitation and affective neurointerfaces.

Deep EEG Superresolution via Correlating Brain Structural and Functional Connectivities

Resolution- and Stimulus-agnostic Super-Resolution of Ultra-High-Field Functional MRI: Application to Visual Studies

Generative AI Enables EEG Super-Resolution via Spatio-Temporal Adaptive Diffusion Learning

Deep Robust Residual Network for Super-Resolution of 2D Fetal Brain MRI

Super-Resolution Level Separation: A Method for Enhancing Electroencephalogram Classification Accuracy Through Super-Resolution Level Separation

Brain MRI Super-resolution Reconstruction Using a Multi-level and Parallel Conv-Deconv Network

CSR-dMRI: Continuous Super-Resolution of Diffusion MRI with Anatomical Structure-assisted Implicit Neural Representation Learning

Deep neural networks constrained by neural mass models improve electrophysiological source imaging of spatiotemporal brain dynamics

An Intelligent EEG Classification Methodology Based on Sparse Representation Enhanced Deep Learning Networks

TV-based Deep 3D Self Super-Resolution for fMRI

Cross-Modality Reference and Feature Mutual-Projection for 3D Brain MRI Image Super-Resolution

Progressive Sub-band Residual-Learning Network for MR Image Super Resolution.

Recycling diagnostic MRI for empowering brain morphometric research – Critical & practical assessment on learning-based image super-resolution

Brain Graph Super-Resolution Using Adversarial Graph Neural Network with Application to Functional Brain Connectivity

Functional Source Separation for EEG-fMRI Fusion: Application to Steady-State Visual Evoked Potentials

Beyond the Surface: Revealing the Depths of Brain Activity by Predicting fMRI from EEG with Deep Learning

Unified Convolutional Sparse Transformer for Disease Diagnosis, Monitoring, Drug Development, and Therapeutic Effect Prediction from EEG Raw Data

MASER: Enhancing EEG Spatial Resolution With State Space Modeling

No-Clean-Reference Image Super-Resolution: Application to Electron Microscopy

Constructing Fine-Granularity Functional Brain Network Atlases Via Deep Convolutional Autoencoder.

ESTformer: Transformer Utilizing Spatiotemporal Dependencies for EEG Super-resolution