Abstract:Accurate optical and synthetic aperture radar (SAR) image registration is crucial to multisensor remote sensing applications. Though several algorithms have been proposed, the practical implementation that directly matches large and high-resolution optical and SAR images remains underexplored by the community. Equipped with the satellite positioning parameters, optical and SAR images can be roughly registered based on geographic coordinates. However, the relative positioning accuracy is still dozens, even hundreds of pixels due to the inaccuracies of sensor parameters and elevation. Consequently, we propose a robust registration algorithm, which consists of two stages, where the horizontal positioning errors can be reduced in the first stage, and then, we fine-tune the correspondences in the second stage. Specifically, we propose a novel template matching method based on the dilated convolutional feature (DCF) and epipolar-oriented phase correlation. DCF is constructed by a depthwise-separable dilated convolution with multichannel gradients, which are generated by the Sobel operator for optical images and a ratio of exponentially weighted averages (ROEWA) operator for SAR images. Due to the large reception field of dilated convolution, DCF can retain invariance even for large relative positioning errors. The epipolar-oriented rectangle template, which stretches along the epipolar line, is then proposed to capture more overlapping areas compared to square templates. Furthermore, the outlier removal is implemented in the coordinate system of optical images to avoid the effect of range compression in SAR images. Inliers are finally used to refine the rational polynomial coefficients (RPCs) based on the bundle adjustment technique. Experimental results on high-resolution optical and SAR image products of various scenarios demonstrate the effectiveness of the proposed registration framework. The relative positioning errors of the refined RPCs can be reduced from hundreds of pixels to the subpixel level.

An improved InSAR image registration algorithm

An Improved InSAR Image Co-Registration Method for Pairs with Relatively Big Distortions or Large Incoherent Areas

A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

A SAR Image Registration Algorithm Using Edge Information Combined with Gray-Level Information

Improving Co-Registration for Sentinel-1 SAR and Sentinel-2 Optical Images

A Novel Coarse-to-Fine Image Registration for Repeat-Pass InSAR Based on Gabor Filter Feature and Its Application in Terahertz Region

SAR Image Registration with Sift Features and Edge Points

An SAR Image Registration Algorithm Based on Edge Intersection Extraction and Retrained HardNet

Spatial Feature-Based ISAR Image Registration for Space Targets

A Transformer-Based Coarse-to-Fine Wide-Swath SAR Image Registration Method under Weak Texture Conditions

An improved SIFT algorithm for registration between SAR and optical images

Optical and SAR Image Registration Based on Pseudo-SAR Image Generation Strategy

SAR Image Registration Based on ROEWA-Blocks and Multiscale Circle Descriptor

A New Method for Multi-Spectral and SAR Remote Sensing Image Registration

A Robust Multiscale Edge Detection Method for Accurate SAR Image Registration

An Improved Method for Remote Sensing Image Registration

SAR Image Registration: The Combination of Nonlinear Diffusion Filtering, Hessian Features and Edge Points

A Robust Two-Stage Registration Algorithm for Large Optical and SAR Images

Universal SAR and optical image registration via a novel SIFT framework based on nonlinear diffusion and a polar spatial-frequency descriptor

Auto SAR Image Registration Based on Strong Corner

An Automatic and Novel SAR Image Registration Algorithm: A Case Study of the Chinese GF-3 Satellite