Abstract:We introduce RetinaRegNet, a zero-shot image registration model designed to register retinal images with minimal overlap, large deformations, and varying image quality. RetinaRegNet addresses these challenges and achieves robust and accurate registration through the following steps. First, we extract features from the moving and fixed images using latent diffusion models. We then sample feature points from the fixed image using a combination of the SIFT algorithm and random point sampling. For each sampled point, we identify its corresponding point in the moving image using a 2D correlation map, which computes the cosine similarity between the diffusion feature vectors of the point in the fixed image and all pixels in the moving image. Second, we eliminate most incorrectly detected point correspondences (outliers) by enforcing an inverse consistency constraint, ensuring that correspondences are consistent in both forward and backward directions. We further remove outliers with large distances between corresponding points using a global transformation based outlier detector. Finally, we implement a two-stage registration framework to handle large deformations. The first stage estimates a homography transformation to achieve global alignment between the images, while the second stage uses a third-order polynomial transformation to estimate local deformations. We evaluated RetinaRegNet on three retinal image registration datasets: color fundus images, fluorescein angiography images, and laser speckle flowgraphy images. Our model consistently outperformed state-of-the-art methods across all datasets. The accurate registration achieved by RetinaRegNet enables the tracking of eye disease progression, enhances surgical planning, and facilitates the evaluation of treatment efficacy. Our code is publicly available at: <a class="link-external link-https" href="https://github.com/mirthAI/RetinaRegNet" rel="external noopener nofollow">this https URL</a>.

Retinal IPA: Iterative KeyPoints Alignment for Multimodal Retinal Imaging

Adapting the Segment Anything Model for Multi-modal Retinal Anomaly Detection and Localization

Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full and Annotations

Multi-modal Retinal Image Registration Using a Keypoint-Based Vessel Structure Aligning Network

Progressive Retinal Image Registration via Global and Local Deformable Transformations

Robust point matching method for multimodal retinal image registration

Color Fundus Photograph Registration Based on Feature and Intensity for Longitudinal Evaluation of Diabetic Retinopathy Progression

A Robust Outlier Elimination Approach for Multimodal Retina Image Registration

Rotation-Oriented Collaborative Self-Supervised Learning for Retinal Disease Diagnosis

RetinaRegNet: A Zero-Shot Approach for Retinal Image Registration

Retinal Structure Detection in OCTA Image via Voting-Based Multitask Learning

Retinal fundus image registration framework using Bayesian integration and asymmetric Gaussian mixture model

RetinaMatch: Efficient Template Matching of Retina Images for Teleophthalmology

Retinal Fundus Image Registration Via Vascular Structure Graph Matching.

RET-CLIP: A Retinal Image Foundation Model Pre-trained with Clinical Diagnostic Reports

OTRE: Where Optimal Transport Guided Unpaired Image-to-Image Translation Meets Regularization by Enhancing

Fundus-Enhanced Disease-Aware Distillation Model for Retinal Disease Classification from OCT Images

A Keypoint Detection and Description Network Based on the Vessel Structure for Multi-Modal Retinal Image Registration

Retinal Image Registration Using Partial Intensity Invariant Feature Descriptor and Redundant Keypoints Elimination Techniques

RetiGen: A Framework for Generalized Retinal Diagnosis Using Multi-View Fundus Images

UrFound: Towards Universal Retinal Foundation Models via Knowledge-Guided Masked Modeling