Abstract:We introduce RetinaRegNet, a zero-shot image registration model designed to register retinal images with minimal overlap, large deformations, and varying image quality. RetinaRegNet addresses these challenges and achieves robust and accurate registration through the following steps. First, we extract features from the moving and fixed images using latent diffusion models. We then sample feature points from the fixed image using a combination of the SIFT algorithm and random point sampling. For each sampled point, we identify its corresponding point in the moving image using a 2D correlation map, which computes the cosine similarity between the diffusion feature vectors of the point in the fixed image and all pixels in the moving image. Second, we eliminate most incorrectly detected point correspondences (outliers) by enforcing an inverse consistency constraint, ensuring that correspondences are consistent in both forward and backward directions. We further remove outliers with large distances between corresponding points using a global transformation based outlier detector. Finally, we implement a two-stage registration framework to handle large deformations. The first stage estimates a homography transformation to achieve global alignment between the images, while the second stage uses a third-order polynomial transformation to estimate local deformations. We evaluated RetinaRegNet on three retinal image registration datasets: color fundus images, fluorescein angiography images, and laser speckle flowgraphy images. Our model consistently outperformed state-of-the-art methods across all datasets. The accurate registration achieved by RetinaRegNet enables the tracking of eye disease progression, enhances surgical planning, and facilitates the evaluation of treatment efficacy. Our code is publicly available at: <a class="link-external link-https" href="https://github.com/mirthAI/RetinaRegNet" rel="external noopener nofollow">this https URL</a>.

A Robust Outlier Elimination Approach for Multimodal Retina Image Registration

Accurate Range Image Registration: Eliminating or Modelling Outliers

An Accurate and Robust Registration Framework Based on Outlier Removal and Feature Point Adjustment for Remote Sensing Images

Robust point matching method for multimodal retinal image registration

An Iterative SIFT Based on Intensity and Spatial Information for Remote Sensing Image Registration

A High Precision Feature Matching Method Based On Geometrical Outlier Removal For Remote Sensing Image Registration

Iterative Scale-Invariant Feature Transform for Remote Sensing Image Registration

Color Fundus Photograph Registration Based on Feature and Intensity for Longitudinal Evaluation of Diabetic Retinopathy Progression

A Novel Image Registration Method Based on Geometrical Outlier Removal

Retinal Image Registration Using Partial Intensity Invariant Feature Descriptor and Redundant Keypoints Elimination Techniques

A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

3D Biological/Biomedical Image Registration with enhanced Feature Extraction and Outlier Detection

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Multi-sensor Images Registration Based on SIFT and Extended Phase Correlation

Mutual Information-Based Registration of Temporal and Stereo Retinal Images Using Constrained Optimization.

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

Optical Remote Sensing Image Registration Using Spatial-Consistency and Average Regional Information Divergence Minimization Via Quantum-Behaved Particle Swarm Optimization.

RetinaRegNet: A Zero-Shot Approach for Retinal Image Registration

Retinal fundus image registration framework using Bayesian integration and asymmetric Gaussian mixture model

Automatic Registration of Images with Inconsistent Content Through Line-Support Region Segmentation and Geometrical Outlier Removal