Abstract:Accurate optical and synthetic aperture radar (SAR) image registration is crucial to multisensor remote sensing applications. Though several algorithms have been proposed, the practical implementation that directly matches large and high-resolution optical and SAR images remains underexplored by the community. Equipped with the satellite positioning parameters, optical and SAR images can be roughly registered based on geographic coordinates. However, the relative positioning accuracy is still dozens, even hundreds of pixels due to the inaccuracies of sensor parameters and elevation. Consequently, we propose a robust registration algorithm, which consists of two stages, where the horizontal positioning errors can be reduced in the first stage, and then, we fine-tune the correspondences in the second stage. Specifically, we propose a novel template matching method based on the dilated convolutional feature (DCF) and epipolar-oriented phase correlation. DCF is constructed by a depthwise-separable dilated convolution with multichannel gradients, which are generated by the Sobel operator for optical images and a ratio of exponentially weighted averages (ROEWA) operator for SAR images. Due to the large reception field of dilated convolution, DCF can retain invariance even for large relative positioning errors. The epipolar-oriented rectangle template, which stretches along the epipolar line, is then proposed to capture more overlapping areas compared to square templates. Furthermore, the outlier removal is implemented in the coordinate system of optical images to avoid the effect of range compression in SAR images. Inliers are finally used to refine the rational polynomial coefficients (RPCs) based on the bundle adjustment technique. Experimental results on high-resolution optical and SAR image products of various scenarios demonstrate the effectiveness of the proposed registration framework. The relative positioning errors of the refined RPCs can be reduced from hundreds of pixels to the subpixel level.

Auto SAR Image Registration Based on Strong Corner

Auto Image Registration Based on Corner Feature

A robust improved image stitching algorithm based on keypoints registration

Auto Registration Algorithm Research of Synthetic Aperture Radar Image

Image registration based on corner detection and affine transformation

Automatic Remote Sensing Image Registration Based on VTS-PCMIC Algorithm

SAR Image Automatic Registration Based on PCA-SIFT and Mahalanobis Distance

Automatic Remote Sensing Image Registration Algorithm Based on SIFT

SAR Image Registration with Sift Features and Edge Points

Multi-view SAR image registration based on feature extraction

An SAR Image Registration Algorithm Based on Edge Intersection Extraction and Retrained HardNet

A Geometry-Aware Registration Algorithm for Multiview High-Resolution SAR Images

Universal SAR and optical image registration via a novel SIFT framework based on nonlinear diffusion and a polar spatial-frequency descriptor

A Robust Two-Stage Registration Algorithm for Large Optical and SAR Images

Mesh Based Automatic Image Registration

Infrared and Visible Image Registration in UAV Inspection

A SAR Image Registration Algorithm Using Edge Information Combined with Gray-Level Information

Automatic Registration of Optical and SAR Images Via Improved Phase Congruency Model.

A Robust Medical Image Registration Algorithm Based on the SAM of Multi-Scale Harris Corners

Combining Optimized SAR-SIFT Features and RD Model for Multisource SAR Image Registration

A Transformer-Based Coarse-to-Fine Wide-Swath SAR Image Registration Method under Weak Texture Conditions