Abstract:Multisensor remote sensing applications require the registration of optical and synthetic aperture radar (SAR) images, which presents challenges due to significant radiometric and geometric differences resulting from distinct imaging mechanisms. Although various algorithms have been proposed, including hand-crafted features and deep learning networks, most of them focus on matching radiometric-invariant features while ignoring geometric differences. Furthermore, these algorithms often achieve promising results on datasets that use manually labeled ground truths that may be less reliable for high-resolution SAR images affected by speckle noise. To address these issues, we propose a robust global-to-local registration algorithm consisting of four modules: geocoding, global matching, local matching, and refinement. We generate a geometry-invariant mask in the geocoding module to help the local matching module focus on valid areas, introduce a fast global matching method to solve large offsets, and use matching confidence (MC) to guide subsequent local matching based on the accuracy of global matching. We propose a feature based on multidirectional anisotropic Gaussian derivatives (MAGDs) and embed it into the confidence-aware local matching with the geometry-invariant mask to reduce the effect of geometric differences. Finally, we refine correspondence positions and remove outliers. We also build a high-accuracy evaluation dataset with hundreds of image pairs, where the ground truth is obtained by meta poles, which have clear and reliable structures in both optical and SAR images. Experimental results on this dataset demonstrate the superiority of our proposed algorithm compared with several state-of-the-art methods.

Infrared and Visible Images Registration with Adaptable Local-Global Feature Integration for Rail Inspection

An Infrared-Optical Image Registration Method for Industrial Blower Monitoring Based on Contour-Shape Descriptors

Infrared and Visible Image Registration in UAV Inspection

Research on Infrared and Visible Image Registration Algorithm for Complex Road Scenes.

Multi-Modal Image Registration Based on Local Self-Similarity and Bidirectional Matching

Robust and Efficient Registration of Infrared and Visible Images for Vehicular Imaging Systems

Image Registration Between Visible and Infrared Images for Electrical Equipment Inspection Robots Based on Quadrilateral Features

A Robust Method for Electrical Equipment Infrared and Visible Image Registration

A Global-to-Local Algorithm for High-Resolution Optical and SAR Image Registration.

A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images with Mixed Features.

An End-to-End Infrared and Visual Fusion Detection Framework for Near-Surface Defect in Moving Mode

A Contour Angle Orientation for Power Equipment Infrared and Visible Image Registration

Research on infrared and visible image registration of substation equipment based on Multi-scale Retinex and ASIFT features

Dense Remote Sensing Image Registration in Complex Terrain Areas Based on Feature Descriptors

Visible And Infrared Image Registration Algorithm Based On Nsct And Gradient Mirroring

Robust Multi-Modal Image Registration for Image Fusion Enhancement in Infrastructure Inspection

Remote Sensing Image Registration Based on Dynamic Threshold Calculation Strategy and Multiple-Feature Distance Fusion.

Infrared object tracking based on gray and SURF features fusion

Ir and Visible Images Registration Method Based on Cross Cumulative Residual Entropy

Robust Registration for Ultra-Field Infrared and Visible Binocular Images