Abstract:Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are the two most commonlyusednon-invasive methods for studying brain function, having different but complementary strengths: high temporal resolution of the former and high spatial resolution of the latter. Crucially, fMRI is vital for studying subcortical areas, as those are practically out of reach for conventional EEG. At the same time, EEG is cost-effective and, thus, often preferable to fMRI if comparable information could be extracted which is not the case then the deep subcortical brain activity is of interest. Here we explore the possibility of recovering subcortical hemodynamics from the non-invasively recorded scalp EEG signals. To this end, we have developed a lightweight EEG-to-fMRI neural network and using an extended and publicly available dataset with concurrently recorded EEG-fMRI data show that our model allows for the prediction of the detailed Blood Oxygenation Level Dependent (BOLD) activity of 7 bilaterally symmetric subcortical structures solely from multichannel EEG data. We report the performance significantly above chance and exceeding the scores achieved for a single subcortical structure and obtained on the proprietary datasets. In contrast to the studies focusing on a single subcortical region in our approach we were able to decode multichannel EEG into 14 + 4 region-specific variations of BOLD signals measured relative to their mean hemodynamic activity. The use of relative BOLD signals allowed us to exert control over the artificial inflation of decoding accuracy scores when the decoder predicts the common mode component that is likely to have a non-neuronal origin (heartbeat, movement, etc). Finally, we interpreted our model. The electrical activity of the sensorimotor cortex appeared to contribute most to the prediction of the subcortical hemodynamics. Also, the hemodynamics of the thalamus has the smallest delay with respect to the EEG signals. Both observations are physiologically plausible and ensure the potential reliability of the decoder. Taken together, these findings pave the road towards the creation of low-cost AI-powered EEG-based fMRI digital twin technology capable of tracking subcortical activity in an ecological setting. The technology, once mature, will find numerous applications from fundamental neuroscience through diagnostics to neurorehabilitation and affective neurointerfaces.

Prediction of Working Memory Ability Based on EEG by Functional Data Analysis

Direct comparison of EEG resting state and task functional connectivity patterns for predicting working memory performance using connectome-based predictive modeling

Prediction of Human Cognitive Abilities Based on EEG Measurements.

Predicting the effectiveness of binaural beats on working memory

Prediction of Cognitive Task Activations via Resting-State Functional Connectivity Networks: An EEG Study

Training State and Performance Evaluation of Working Memory Based on Task-Related EEG

EEG/fNIRS Based Workload Classification Using Functional Brain Connectivity and Machine Learning

Using modular connectome-based predictive modeling to reveal brain-behavior relationships of individual differences in working memory

An adaptive wavelet approach for joint EEG-fMRI data

EEG Cortical Connectivity Analysis of Working Memory Reveals Topological Reorganization in Theta and Alpha Bands

[Neurovascular Coupling Analysis of Working Memory Based on Electroencephalography and Functional Near-Infrared Spectroscopy].

Predicting individual decision-making responses based on single-trial EEG

Resting state EEG complexity as a predictor of cognitive performance

EEG connectome-based predictive modeling of nonverbal intelligence level in healthy subjects

EEG-based mental fatigue detection using linear prediction cepstral coefficients and Riemann spatial covariance matrix

Long-Term EEG Component Analysis Method Based on Lasso Regression

EEG-Based Prediction of Cognitive Load in Intelligence Tests

Working Memory Load-Dependent Spatio-Temporal Activity of Single-Trial P3 Response Detected with an Adaptive Wavelet Denoiser.

An EEG-based Mental Workload Estimator Trained on Working Memory Task Can Work Well under Simulated Multi-Attribute Task.

Decoding Working Memory Representation Based on Single-Trial EEG by a Deep Learning Framework

Beyond the Surface: Revealing the Depths of Brain Activity by Predicting fMRI from EEG with Deep Learning