Abstract:Oculomotor activity provides critical insights into cognition and health, with growing evidence demonstrating its involvement in various cognitive functions such as attention, memory, and sensory processing. Furthermore, eye movements are emerging as significant indicators of psychopathologies and neurological disorders, including schizophrenia, dementia, depression, and tinnitus. Despite its crucial importance across domains, the role of oculomotion has often been underexplored in neuroimaging studies - largely due to methodological challenges. Eye movements have traditionally been viewed as artefacts in the neural signal, leading to the exclusion of epochs containing them, or correction methods to remove their influence. However, this strategy does not allow us to determine their role in a range of neural effects or mapping between tasks and neural responses. To enable such nuanced investigations in typical function and disease, we introduce what we term "Ocular Response Functions". We used simultaneous magnetoencephalographic and eye-tracking recordings during the resting-state combined with temporal response functions to precisely map the relationship between oculomotion and neural activity. Our approach allows for the temporally and spatially precise prediction of neural activity based on ocular action, and vice versa. We further validate this method in a passive listening task, highlighting its potential for uncovering cognitive insights in experimental settings. By providing a robust framework for examining the interplay between eye movements and neural processes, our method opens new avenues for both research and clinical applications, potentially advancing early detection and intervention strategies for neurological and psychiatric disorders.

Neuro-Eye: Decoding of High-Temporal Resolution Eye Movements via Functional Magnetic Resonance Imaging

Magnetic resonance-based eye tracking using deep neural networks

Eye-Moving Assisted Eeg Acquisition and Eeg Feature Detection

MRGazer: Decoding Eye Gaze Points from Functional Magnetic Resonance Imaging in Individual Space

Decoding Visual Network-Related Dynamic Functional Connectivity for Eyes-Open and Eyes-Closed Using Machine Learning

Cognitive Functional Magnetic Resonance Imaging at Very-High-Field: Eye Movement Control

Estimation of Neural Inputs and Detection of Saccades and Smooth Pursuit Eye Movements by Sparse Bayesian Learning

The "Ocular Response Function" for encoding and decoding oculomotor related neural activity

An Interpretable and Attention-based Method for Gaze Estimation Using Electroencephalography

NeuroCine: Decoding Vivid Video Sequences from Human Brain Activties

Unidirectional brain-computer interface: Artificial neural network encoding natural images to fMRI response in the visual cortex

Eye-gaze Estimation with HEOG and Neck EMG Using Deep Neural Networks

eyeSay: Brain Visual Dynamics Decoding With Deep Learning & Edge Computing

End-to-End Eye Movement Detection Using Convolutional Neural Networks

Modeling Human Eye Movements with Neural Networks in a Maze-Solving Task

Focused State Recognition Using EEG with Eye Movement-Assisted Annotation

Deep learning network to correct axial and coronal eye motion in 3D OCT retinal imaging

Leveraging Persistent Homology of Eye Movements for Neural Disorder Screening

Brainnetformer: Decoding Brain Cognitive States with Spatial-Temporal Cross Attention

Deep learning and eye-tracking for accurate EOG rejection

Emotion Recognition Using Eye Gaze Based On Shallow Cnn With Identity Mapping