Improvements to strip-based digital image registration for robust eye-tracking and to minimize distortions in images from scanned ophthalmic imaging systems

Min Zhang,Elena Gofas-Salas,Bianca T. Leonard,Yuhua Rui,Valerie Snyder,Hope Reecher,Pedro Mecê,Ethan A. Rossi
DOI: https://doi.org/10.1101/2020.12.07.414854
2020-12-08
Abstract:ABSTRACT Retinal image-based eye tracking from scanned ophthalmic imaging systems, such as scanning laser ophthalmoscopy, has allowed for precise real-time eye tracking at sub-micron resolution. To achieve real-time processing rates, strip-based image registration methods for real-time applications have several constraints that limit their performance. This trade-off is acceptable for many imaging and psychophysical applications but when the objective is precise eye motion measurement over time, a high error tolerance can be consequential. Dropped strips in these applications can complicate FEMs quantification. Some light starved imaging applications, such as autofluorescence retinal imaging, also require the retention and registration of as much of the data as possible to increase the signal to noise ratio in the final integrated or averaged image. We show here that eye motion can be extracted from image sequences from scanned imaging systems more consistently when the constraints of real-time processing are lifted, and all data is available at the time of registration. This is enabled with additional image processing steps to achieve a more robust solution. Our iterative approach identifies and discards distorted frames, detects coarse motion to generate a synthetic reference frame and then uses it for fine scale motion tracking with improved sensitivity over a larger area. We demonstrate its application here to tracking scanning laser ophthalmoscopy (TSLO) and adaptive optics scanning light ophthalmoscopy (AOSLO). We show that it can successfully capture most of the eye motion across each image sequence, leaving only between 0.04-3.39% of non-blink frames untracked, even with low quality images, while simultaneously minimizing image distortions induced from eye motion. These improvements will facilitate precise FEMs measurement in TSLO and longitudinal tracking of individual cells in AOSLO.
What problem does this paper attempt to address?