Abstract:Abstract Eye motion is a major confound for magnetic resonance imaging (MRI) in neuroscience or ophthalmology. Currently, solutions toward eye stabilisation include participants fixating or administration of paralytics/anaesthetics. We developed a novel MRI protocol for acquiring 3-dimensional images while the eye freely moves. Eye motion serves as the basis for image reconstruction, rather than an impediment. We fully reconstruct videos of the moving eye and head. We quantitatively validate data quality with millimetre resolution in two ways for individual participants. First, eye position based on reconstructed images correlated with simultaneous eye-tracking. Second, the reconstructed images preserve anatomical properties; the eye’s axial length measured from MRI images matched that obtained with ocular biometry. The technique operates on a standard clinical setup, without necessitating specialized hardware, facilitating wide deployment. In clinical practice, we anticipate that this may help reduce burden on both patients and infrastructure, by integrating multiple varieties of assessments into a single comprehensive session. More generally, our protocol is a harbinger for removing the necessity of fixation, thereby opening new opportunities for ethologically-valid, naturalistic paradigms, the inclusion of populations typically unable to stably fixate, and increased translational research such as in awake animals whose eye movements constitute an accessible behavioural readout. Author contributions B.F., L.D.S., M.S., and M.M.M. conceptualised the problem. B.F. and L.D.S. developed, implemented, and tested the protocol. A.M. provided optometry assessments and assisted with eye movement analysis. S.I., D.Z., and M.P.N. assisted with installation of the eye-tracking system within the MRI scanner. J.A.M.B., J.J. and J.Y. contributed with the MRI sequences and compressed sensing framework. B.F., L.D.S. and M.M.M. drafted the manuscript, and all authors contributed to internal review. Competing interests B.F., L.D.S., J.A.M.B., J.Y., M.S., and M.M.M. declare the following competing financial interest: a patent application for the protocol described in this manuscript has been filed (patent application: EP19160832). A.M., S.I., D.Z., M.P.N. and J.J. declare no competing financial interests.

Magnetic resonance-based eye tracking using deep neural networks

Neuro-Eye: Decoding of High-Temporal Resolution Eye Movements via Functional Magnetic Resonance Imaging

MRGazer: Decoding Eye Gaze Points from Functional Magnetic Resonance Imaging in Individual Space

3-Dimensional Magnetic Resonance Imaging of the Freely Moving Human Eye

Deep Learning for Micro-Electrocorticographic (µecog) Data

A CNN and LSTM Network for Eye-Blink Classification from MRI Scanner Monitoring Videos

Deep learning models for webcam eye tracking in online experiments

End-to-End Eye Movement Detection Using Convolutional Neural Networks

Test Platform for Developing New Optical Position Tracking Technology towards Improved Head Motion Correction in Magnetic Resonance Imaging

Efficient Egocentric Visual Perception Combining Eye-tracking, a Software Retina and Deep Learning

A Deep Learning-Based Approach to Video-Based Eye Tracking for Human Psychophysics

An Interpretable and Attention-based Method for Gaze Estimation Using Electroencephalography

Deep learning and eye-tracking for accurate EOG rejection

Eye-Opening Advances: Automated 3D Segmentation, Key Biomarkers Extraction, and the First Large-Scale MRI Eye Atlas

Tracking Eye Movement Using a Composite Magnet

Privacy-Preserving Eye-tracking Using Deep Learning

Deep Eyedentification: Biometric Identification using Micro-Movements of the Eye

A non-inductive magnetic eye-tracker: from dipole tracking to gaze retrieval

Development of a Magnetoresistive-Based Wearable Eye-Tracking System for Oculomotor Assessment in Neurological and Otoneurological Research—Preliminary In Vivo Tests

Markerless tracking of user-defined features with deep learning

Estimation of Neural Inputs and Detection of Saccades and Smooth Pursuit Eye Movements by Sparse Bayesian Learning