Abstract:Multisensor remote sensing applications require the registration of optical and synthetic aperture radar (SAR) images, which presents challenges due to significant radiometric and geometric differences resulting from distinct imaging mechanisms. Although various algorithms have been proposed, including hand-crafted features and deep learning networks, most of them focus on matching radiometric-invariant features while ignoring geometric differences. Furthermore, these algorithms often achieve promising results on datasets that use manually labeled ground truths that may be less reliable for high-resolution SAR images affected by speckle noise. To address these issues, we propose a robust global-to-local registration algorithm consisting of four modules: geocoding, global matching, local matching, and refinement. We generate a geometry-invariant mask in the geocoding module to help the local matching module focus on valid areas, introduce a fast global matching method to solve large offsets, and use matching confidence (MC) to guide subsequent local matching based on the accuracy of global matching. We propose a feature based on multidirectional anisotropic Gaussian derivatives (MAGDs) and embed it into the confidence-aware local matching with the geometry-invariant mask to reduce the effect of geometric differences. Finally, we refine correspondence positions and remove outliers. We also build a high-accuracy evaluation dataset with hundreds of image pairs, where the ground truth is obtained by meta poles, which have clear and reliable structures in both optical and SAR images. Experimental results on this dataset demonstrate the superiority of our proposed algorithm compared with several state-of-the-art methods.

Geo-Registration Of Aerial Images By Feature Matching

Real-time and High Precision Feature Matching Between Blur Aerial Images

A Real-Time Registration Algorithm of UAV Aerial Images Based on Feature Matching

Feature-based geometric registration of high spatial resolution satellite imagery

A High Precision Feature Matching Method Based On Geometrical Outlier Removal For Remote Sensing Image Registration

Infrared and Visible Image Registration in UAV Inspection

Remote Sensing Image Registration Using Multiple Image Features

A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

A Matching-Based Automatic Registration For Remotely Sensed Imagery

A Fast and Fully Automatic Registration Approach Based on Point Features for Multi-Source Remote-Sensing Images

A Global-to-Local Algorithm for High-Resolution Optical and SAR Image Registration.

Robust Feature Matching for Remote Sensing Image Registration via Guided Hyperplane Fitting

An Accurate Registration Method Based on Global Mixed Structure Similarity (GMSIM) for Remote Sensing Images

Fast Automatic Registration of UAV Images via Bidirectional Matching

Study on image automatism registration methods based on matching

A Remote Sensing Imagery Automatic Feature Registration Method Based on Mean-Shift.

An AR Geo-Registration Algorithm for UAV TIR Video Streams Based on Dual-Antenna RTK-GPS

A Robust Aerial Image Registration Method Using Gaussian Mixture Models.

Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matching

A Small UAV Based Multi-Temporal Image Registration for Dynamic Agricultural Terrace Monitoring

New Geo-Location Approach Based on Camera Coordinates and Common Points on Multiple Images