Abstract:Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are the two most commonlyusednon-invasive methods for studying brain function, having different but complementary strengths: high temporal resolution of the former and high spatial resolution of the latter. Crucially, fMRI is vital for studying subcortical areas, as those are practically out of reach for conventional EEG. At the same time, EEG is cost-effective and, thus, often preferable to fMRI if comparable information could be extracted which is not the case then the deep subcortical brain activity is of interest. Here we explore the possibility of recovering subcortical hemodynamics from the non-invasively recorded scalp EEG signals. To this end, we have developed a lightweight EEG-to-fMRI neural network and using an extended and publicly available dataset with concurrently recorded EEG-fMRI data show that our model allows for the prediction of the detailed Blood Oxygenation Level Dependent (BOLD) activity of 7 bilaterally symmetric subcortical structures solely from multichannel EEG data. We report the performance significantly above chance and exceeding the scores achieved for a single subcortical structure and obtained on the proprietary datasets. In contrast to the studies focusing on a single subcortical region in our approach we were able to decode multichannel EEG into 14 + 4 region-specific variations of BOLD signals measured relative to their mean hemodynamic activity. The use of relative BOLD signals allowed us to exert control over the artificial inflation of decoding accuracy scores when the decoder predicts the common mode component that is likely to have a non-neuronal origin (heartbeat, movement, etc). Finally, we interpreted our model. The electrical activity of the sensorimotor cortex appeared to contribute most to the prediction of the subcortical hemodynamics. Also, the hemodynamics of the thalamus has the smallest delay with respect to the EEG signals. Both observations are physiologically plausible and ensure the potential reliability of the decoder. Taken together, these findings pave the road towards the creation of low-cost AI-powered EEG-based fMRI digital twin technology capable of tracking subcortical activity in an ecological setting. The technology, once mature, will find numerous applications from fundamental neuroscience through diagnostics to neurorehabilitation and affective neurointerfaces.

Reconstructing lost BOLD signal in individual participants using deep machine learning

Improving the precision of fMRI BOLD signal deconvolution with implications for connectivity analysis

Machine Learning on Dynamic Functional Connectivity: Promise, Pitfalls, and Interpretations

Beyond the Surface: Revealing the Depths of Brain Activity by Predicting fMRI from EEG with Deep Learning

Deep Linear Matrix Approximate Reconstruction Reveals Reproducible Large-Scale Functional Connectivity Networks in the Human Brain

NeuroBOLT: Resting-state EEG-to-fMRI Synthesis with Multi-dimensional Feature Mapping

A Hybrid Spatio-Temporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multi-Level Core Functional Components in Decoding Multi-Task fMRI Signals

A blind deconvolution approach to recover effective connectivity brain networks from resting state fMRI data

A Hybrid Spatiotemporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multilevel Core Functional Components in Decoding Multitask Fmri Signals.

MindLDM: Reconstruct Visual Stimuli from Fmri Using Latent Diffusion Model

Reconstructing Circuit Connectivity from in vivo Spike Trains Using Deep Domain-Adaptive Matching

Reconstruction of Behavior-Relevant Individual Brain Activity: an Individualized Fmri Study

Deep Learning Identifies Neuroimaging Signatures of Alzheimer's Disease Using Structural and Synthesized Functional MRI Data

Natural Image Reconstruction From fMRI Using Deep Learning: A Survey

Uncovering cognitive taskonomy through transfer learning in masked autoencoder-based fMRI reconstruction

Deep Natural Image Reconstruction from Human Brain Activity Based on Conditional Progressively Growing Generative Adversarial Networks

Beyond functional connectivity: deep learning applied to resting-state fMRI time series in the prediction of 58 human traits in the HCP

Reconstruction of Physiological Signals Using Iterative Retraining and Accumulated Averaging of Neural Network Models

Enhanced image quality and lesion detection in FLAIR MRI of white matter hyperintensity through deep learning-based reconstruction

Deep Neural Imputation: A Framework for Recovering Incomplete Brain Recordings

Analysis of Functional Areas of Human Brain Based on Reconstructed Images of DMFG-generated Countermeasure Network