Abstract:We introduce RetinaRegNet, a zero-shot image registration model designed to register retinal images with minimal overlap, large deformations, and varying image quality. RetinaRegNet addresses these challenges and achieves robust and accurate registration through the following steps. First, we extract features from the moving and fixed images using latent diffusion models. We then sample feature points from the fixed image using a combination of the SIFT algorithm and random point sampling. For each sampled point, we identify its corresponding point in the moving image using a 2D correlation map, which computes the cosine similarity between the diffusion feature vectors of the point in the fixed image and all pixels in the moving image. Second, we eliminate most incorrectly detected point correspondences (outliers) by enforcing an inverse consistency constraint, ensuring that correspondences are consistent in both forward and backward directions. We further remove outliers with large distances between corresponding points using a global transformation based outlier detector. Finally, we implement a two-stage registration framework to handle large deformations. The first stage estimates a homography transformation to achieve global alignment between the images, while the second stage uses a third-order polynomial transformation to estimate local deformations. We evaluated RetinaRegNet on three retinal image registration datasets: color fundus images, fluorescein angiography images, and laser speckle flowgraphy images. Our model consistently outperformed state-of-the-art methods across all datasets. The accurate registration achieved by RetinaRegNet enables the tracking of eye disease progression, enhances surgical planning, and facilitates the evaluation of treatment efficacy. Our code is publicly available at: <a class="link-external link-https" href="https://github.com/mirthAI/RetinaRegNet" rel="external noopener nofollow">this https URL</a>.

Improvements to strip-based digital image registration for robust eye-tracking and to minimize distortions in images from scanned ophthalmic imaging systems

Substrip-based registration and automatic montaging of adaptive optics retinal images

Color Fundus Photograph Registration Based on Feature and Intensity for Longitudinal Evaluation of Diabetic Retinopathy Progression

Non-Rigid Registration for High-Resolution Retinal Imaging

Effects of nucleus basolateralis amygdalae neurotoxic lesions on some spontaneous activities in the rat

Characterization and Analysis of Retinal Axial Motion at High Spatiotemporal Resolution and Its Implication for Real-Time Correction in Human Retinal Imaging

Automated Measurement of Ocular Movements Using Deep Learning-Based Image Analysis

Sciatica, with particular reference to its causes and treatment.

High-resolution in-vivo human retinal imaging using full-field OCT with optical stabilization of axial motion

Hybrid Robot-Assisted Frameworks for Endomicroscopy Scanning in Retinal Surgeries

A highly sensitive enzyme immunoassay for G-CSF in human plasma.

Multispectral Image Analysis for Patient Tissue Tracking During Complex Interventions.

Phase-Restoring Subpixel Image Registration: Enhancing Motion Detection Performance in Fourier-domain Optical Coherence Tomography

High dynamic range 3D motion tracking based on circular scan with optical coherence tomography

Towards Robotic Eye Surgery: Marker-free, Online Hand-eye Calibration using Optical Coherence Tomography Images

An integrated cable condition diagnosis and fault localization system via sheath current monitoring

Pupil Tracking for Real-Time Motion Corrected Anterior Segment Optical Coherence Tomography

Deep learning network to correct axial and coronal eye motion in 3D OCT retinal imaging

Hybrid electromagnetic and image-based tracking of endoscopes with guaranteed smooth output

[Study on the mechanism of placental transport of phosphate (using human placental microvillous (brush border) membrane vesicles)].

RetinaRegNet: A Zero-Shot Approach for Retinal Image Registration