Abstract:Optical and SAR image registration is the primary procedure to exploit the complementary information from the two different image modal types. Although extensive research has been conducted to narrow down the vast radiometric and geometric gaps so as to extract homogeneous characters for feature point matching, few works have considered the registration issue for non-flat terrains, which will bring in more difficulties for not only sparse feature point matching but also outlier removal and geometric relationship estimation. This article addresses these issues with a novel and effective optical-SAR image registration framework. Firstly, sparse feature points are detected based on the phase congruency moment map of the textureless SAR image (SAR-PC-Moment), which helps to identify salient local regions. Then a template matching process using very large local image patches is conducted, which increases the matching accuracy by a significant margin. Secondly, a mutual verification-based initial outlier removal method is proposed, which takes advantage of the different mechanisms of sparse and dense matching and requires no geometric consistency assumption within the inliers. These two procedures will produce a putative correspondence feature point (CP) set with a low outlier ratio and high reliability. In the third step, the putative CPs are used to segment the large input image of non-flat terrain into dozens of locally flat areas using a recursive random sample consensus (RANSAC) method, with each locally flat area co-registered using an affine transformation. As for the mountainous areas with sharp elevation variations, anchor CPs are first identified, and then optical flow-based pixelwise dense matching is conducted. In the experimental section, ablation studies using four precisely co-registered optical-SAR image pairs of flat terrain quantitatively verify the effectiveness of the proposed SAR-PC-Moment-based feature point detector, big template matching strategy, and mutual verification-based outlier removal method. Registration results on four 1 m-resolution non-flat image pairs prove that the proposed framework is able to produce robust and quite accurate registration results.

A Feature-based Method for Automatic SAR Image Registration

Automatic Registration for ASAR and TM Images Based on Region Features

SAR Image Registration: The Combination of Nonlinear Diffusion Filtering, Hessian Features and Edge Points

An automatic optical and SAR image registration method with iterative level set segmentation and SIFT

A New Method for Multi-Spectral and SAR Remote Sensing Image Registration

Automatic Optical-to-SAR Image Registration by Iterative Line Extraction and Voronoi Integrated Spectral Point Matching

A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

SAR Image Registration with Sift Features and Edge Points

Spatial Feature-Based ISAR Image Registration for Space Targets

Registration of optical and SAR remote sensing image base on closed regions features

Infrared and Visible Image Registration in UAV Inspection

Feature-based geometric registration of high spatial resolution satellite imagery

A High Precision Feature Matching Method Based On Geometrical Outlier Removal For Remote Sensing Image Registration

Prominent Structure-Guided Feature Representation for SAR and Optical Image Registration

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

Registration of Large Optical and SAR Images with Non-Flat Terrain by Investigating Reliable Sparse Correspondences

Optical and SAR Image Registration Based on Multi-Scale Orientated Map of Phase Congruency

Automatic Registration of Optical and SAR Images Via Improved Phase Congruency Model.

Combining Optimized SAR-SIFT Features and RD Model for Multisource SAR Image Registration

Optical Remote Sensing Image Registration Using Spatial-Consistency and Average Regional Information Divergence Minimization Via Quantum-Behaved Particle Swarm Optimization.

SAR Image Registration Based on ROEWA-Blocks and Multiscale Circle Descriptor