Abstract:Background: Retinal imaging is widely used to diagnose many diseases, both systemic and eye-specific. In these cases, image registration, which is the process of aligning images taken from different viewpoints or moments in time, is fundamental to compare different images and to assess changes in their appearance, commonly caused by disease progression. Currently, the field of color fundus registration is dominated by classical methods, as deep learning alternatives have not shown sufficient improvement over classic methods to justify the added computational cost. However, deep learning registration methods are still considered beneficial as they can be easily adapted to different modalities and devices following a data-driven learning approach.Methods: In this work, we propose a novel methodology to register color fundus images using deep learning for the joint detection and description of keypoints. In particular, we use an unsupervised neural network trained to obtain repeatable keypoints and reliable descriptors. These keypoints and descriptors allow to produce an accurate registration using RANdom SAmple Consensus (RANSAC). We train the method using the Messidor dataset and test it with the Fundus Image Registration Dataset (FIRE) dataset, both of which are publicly accessible.Results: Our work demonstrates a color fundus registration method that is robust to changes in imaging devices and capture conditions. Moreover, we conduct multiple experiments exploring several of the method's parameters to assess their impact on the registration performance. The method obtained an overall Registration Score of 0.695 for the whole FIRE dataset (0.925 for category S, 0.352 for P, and 0.726 for A).Conclusions: Our proposal improves the results of previous deep learning methods in every category and surpasses the performance of classical approaches in category A which has disease progression and thus represents the most relevant scenario for clinical practice as registration is commonly used in patients with diseases for disease monitoring purposes.

Multimodal Registration of Retinal Images Using Domain-Specific Landmarks and Vessel Enhancement

Adapting the Segment Anything Model for Multi-modal Retinal Anomaly Detection and Localization

Multi-modal Retinal Image Registration Using a Keypoint-Based Vessel Structure Aligning Network

Registration of multimodal and temporal images of the retina using a combined feature-based and statistics-based method.

Color Fundus Photograph Registration Based on Feature and Intensity for Longitudinal Evaluation of Diabetic Retinopathy Progression

Fusion of Multi-Source Retinal Fundus Images Via Automatic Registration for Clinical Diagnosis

Joint keypoint detection and description network for color fundus image registration

Enhanced Vascular Bifurcations Mapping: Refining Fundus Image Registration

Simultaneous segmentation and classification of the retinal arteries and veins from color fundus images

Multimodal Retinal Image Registration Method Based on Speed-Up Robust Feature

Retinal blood vessel segmentation in high resolution fundus photographs using automated feature parameter estimation

Multimodal Transfer Learning-based Approaches for Retinal Vascular Segmentation

Multimodal image registration techniques: a comprehensive survey

Multimodal Affine Registration for ICGA and MCSL Fundus Images of High Myopia

A Keypoint Detection and Description Network Based on the Vessel Structure for Multi-Modal Retinal Image Registration

Non-Rigid Registration for High-Resolution Retinal Imaging

MEMO: Dataset and Methods for Robust Multimodal Retinal Image Registration with Large or Small Vessel Density Differences

Salient Feature Region: A New Method for Retinal Image Registration

Retinal fundus image registration framework using Bayesian integration and asymmetric Gaussian mixture model

Convexity shape constraints for retinal blood vessel segmentation and foveal avascular zone detection

RetinaRegNet: A Zero-Shot Approach for Retinal Image Registration