Abstract:Retinal template matching and registration is an important challenge in teleophthalmology with low-cost imaging devices. However, the images from such devices generally have a small field of view (FOV) and image quality degradations, making matching difficult. In this paper, we develop an efficient and accurate retinal matching technique that combines dimension reduction and mutual information (MI), called RetinaMatch. The dimension reduction initializes the MI optimization as a coarse localization process, which narrows the optimization domain and avoids local optima. The effectiveness of RetinaMatch is demonstrated on the open fundus image database STARE with simulated reduced FOV and anticipated degradations, and on retinal images acquired by adapter-based optics attached to a smartphone. RetinaMatch achieves a success rate over 94% on human retinal images with the matched target registration errors below 2 pixels on average, excluding the observer variability, outperforming standard template matching solutions. In the application of measuring vessel diameter repeatedly, single pixel errors are expected. In addition, our method can be used in the process of image mosaicking with area-based registration, providing a robust approach when feature-based methods fail. To the best of our knowledge, this is the first template matching algorithm for retina images with small template images from unconstrained retinal areas. In the context of the emerging mixed reality market, we envision automated retinal image matching and registration methods as transformative for advanced teleophthalmology and long-term retinal monitoring.

Techniques for temporal registration of retinal images

Elastic Registration for Retinal Images Based on Reconstructed Vascular Trees

A global-to-local matching strategy for registering retinal fundus images

Color Fundus Photograph Registration Based on Feature and Intensity for Longitudinal Evaluation of Diabetic Retinopathy Progression

Retinal Fundus Image Registration Via Vascular Structure Graph Matching.

Parallel tracking and matching for natural feature based AR registration

Mosaicing the Retinal Fundus Images: a Robust Registration Technique Based Approach

Retinal Image Registration Based on Robust Non-Rigid Point Matching Method

Registration of multimodal and temporal images of the retina using a combined feature-based and statistics-based method.

Two-phase Parametric Registration for Retinal Images

Retinal Image Registration Based on Feature

Fundus Image Registration with Binary Morphology Extraction of Feature Points

A Method for Pathological Retinal Image Registration

RetinaMatch: Efficient Template Matching of Retina Images for Teleophthalmology

Keypoint Matching Networks for Longitudinal Fundus Image Affine Registration

A Novel Fusing Algorithm for Retinal Fundus Images

Retinal fundus image registration framework using Bayesian integration and asymmetric Gaussian mixture model

Retinal Image Registration Using Partial Intensity Invariant Feature Descriptor and Redundant Keypoints Elimination Techniques

Retinal Image Registration Based on Features of Vessel-Segmented Image

Mutual Information-Based Registration of Temporal and Stereo Retinal Images Using Constrained Optimization.

Retinal Image Registration Via Feature-Guided Gaussian Mixture Model.