Abstract:Optical coherence tomography angiography (OCTA) plays a crucial role in quantifying and analyzing retinal vascular diseases. However, the limited field of view (FOV) inherent in most commercial OCTA imaging systems poses a significant challenge for clinicians, restricting the possibility to analyze larger retinal regions of high resolution. Automatic stitching of OCTA scans in adjacent regions may provide a promising solution to extend the region of interest. However, commonly-used stitching algorithms face difficulties in achieving effective alignment due to noise, artifacts and dense vasculature present in OCTA images. To address these challenges, we propose a novel retinal OCTA image stitching network, named MR2-Net, which integrates multi-scale representation learning and dynamic location guidance. In the first stage, an image registration network with a progressive multi-resolution feature fusion is proposed to derive deep semantic information effectively. Additionally, we introduce a dynamic guidance strategy to locate the foveal avascular zone (FAZ) and constrain registration errors in overlapping vascular regions. In the second stage, an image fusion network based on multiple mask constraints and adjacent image aggregation (AIA) strategies is developed to further eliminate the artifacts in the overlapping areas of stitched images, thereby achieving precise vessel alignment. To validate the effectiveness of our method, we conduct a series of experiments on two delicately constructed datasets, i.e., OPTOVUE-OCTA and SVision-OCTA. Experimental results demonstrate that our method outperforms other image stitching methods and effectively generates high-quality wide-field OCTA images, achieving a structural similarity index (SSIM) score of 0.8264 and 0.8014 on the two datasets, respectively.

An Automatic Algorithm for Stitching Multi-Sequence Retinal Images

Multi-retinal Images Stitching Based on the Maximum Fusion and Correction Ratio of Gray Average

Fusion of Multi-Source Retinal Fundus Images Via Automatic Registration for Clinical Diagnosis

Color Fundus Photograph Registration Based on Feature and Intensity for Longitudinal Evaluation of Diabetic Retinopathy Progression

Automatic Retinal Image Registration Using Blood Vessel Segmentation and SIFT Feature.

Retinal Image Registration Based on Features of Vessel-Segmented Image

An Automatic Approach for Retinal Vessel Segmentation by Multi-Scale Morphology and Seed Point Tracking

Multimodal Retinal Image Registration Method Based on Speed-Up Robust Feature

An Automatic Evaluation Method for Retinal Image Registration

An Automated Point Set Registration Framework For Multimodal Retinal Image

A Novel Automatic Registration Method for Fluorescein Fundus Angiography Sequences Based on Mutual Information

An Ensemble Retinal Vessel Segmentation Based on Supervised Learning in Fundus Images

A Location-to-segmentation Strategy for Automatic Exudate Segmentation in Colour Retinal Fundus Images

Salient Feature Region: A New Method for Retinal Image Registration

Non-rigid retinal image registration using an unsupervised structure-driven regression network

An Automatic Evaluation Method for Retinal Image Registration Based on Similar Vessel Structure Matching.

Retinal Image Registration Based on Salient Feature Regions

Retinal Image Registration Based on Robust Non-Rigid Point Matching Method

MR2-Net: Retinal OCTA Image Stitching via Multi-Scale Representation Learning and Dynamic Location Guidance

Multiscale Joint Optimization Strategy for Retinal Vascular Segmentation

Optimization method for multi-retinal image mosaic