Abstract:Accurate optical and synthetic aperture radar (SAR) image registration is crucial to multisensor remote sensing applications. Though several algorithms have been proposed, the practical implementation that directly matches large and high-resolution optical and SAR images remains underexplored by the community. Equipped with the satellite positioning parameters, optical and SAR images can be roughly registered based on geographic coordinates. However, the relative positioning accuracy is still dozens, even hundreds of pixels due to the inaccuracies of sensor parameters and elevation. Consequently, we propose a robust registration algorithm, which consists of two stages, where the horizontal positioning errors can be reduced in the first stage, and then, we fine-tune the correspondences in the second stage. Specifically, we propose a novel template matching method based on the dilated convolutional feature (DCF) and epipolar-oriented phase correlation. DCF is constructed by a depthwise-separable dilated convolution with multichannel gradients, which are generated by the Sobel operator for optical images and a ratio of exponentially weighted averages (ROEWA) operator for SAR images. Due to the large reception field of dilated convolution, DCF can retain invariance even for large relative positioning errors. The epipolar-oriented rectangle template, which stretches along the epipolar line, is then proposed to capture more overlapping areas compared to square templates. Furthermore, the outlier removal is implemented in the coordinate system of optical images to avoid the effect of range compression in SAR images. Inliers are finally used to refine the rational polynomial coefficients (RPCs) based on the bundle adjustment technique. Experimental results on high-resolution optical and SAR image products of various scenarios demonstrate the effectiveness of the proposed registration framework. The relative positioning errors of the refined RPCs can be reduced from hundreds of pixels to the subpixel level.

An SAR Image Registration Algorithm Based on Edge Intersection Extraction and Retrained HardNet

A SAR Image Registration Algorithm Using Edge Information Combined with Gray-Level Information

A Robust Multiscale Edge Detection Method for Accurate SAR Image Registration

SAR Image Registration: The Combination of Nonlinear Diffusion Filtering, Hessian Features and Edge Points

Optical and SAR Image Registration Based on Pseudo-SAR Image Generation Strategy

SAR Image Registration with Sift Features and Edge Points

SAR Image Registration Based on ROEWA-Blocks and Multiscale Circle Descriptor

SAR and Optical Image Registration Based on Deep Learning with Co-Attention Matching Module

Auto SAR Image Registration Based on Strong Corner

Self-Supervised SAR Image Registration With SAR-Superpoint and Transformation Aggregation

A Robust 3D Density Descriptor Based on Histogram of Oriented Primary Edge Structure for SAR and Optical Image Co-Registration

Adaptive Self-Supervised SAR Image Registration With Modifications of Alignment Transformation

A Transformer-Based Coarse-to-Fine Wide-Swath SAR Image Registration Method under Weak Texture Conditions

A New Method for Multi-Spectral and SAR Remote Sensing Image Registration

A Geometry-Aware Registration Algorithm for Multiview High-Resolution SAR Images

A Global-to-Local Algorithm for High-Resolution Optical and SAR Image Registration.

High-Precision Pixelwise SAR–Optical Image Registration via Flow Fusion Estimation Based on an Attention Mechanism

Universal SAR and optical image registration via a novel SIFT framework based on nonlinear diffusion and a polar spatial-frequency descriptor

A Robust Two-Stage Registration Algorithm for Large Optical and SAR Images

Combining Optimized SAR-SIFT Features and RD Model for Multisource SAR Image Registration

A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation