Abstract:Image registration is the basis for the joint interpretation of synthetic aperture radar (SAR) and optical images. However, the significant nonlinear radiation difference (NRD) and the geometric imaging model difference render the registration quite challenging. To solve this problem, both traditional and deep learning methods are used to extract structural information with dense descriptions of the images, but they ignore that structural information of the image pair is coupled and often process images separately. In this paper, a deep learning-based registration method with a co-attention matching module (CAMM) for SAR and optical images is proposed, which integrates structural feature maps of the image pair to extract keypoints of a single image. First, joint feature detection and description are carried out densely in both images, for which the features are robust to radiation and geometric variation. Then, a CAMM is used to integrate both images' structural features and generate the final keypoint feature maps so that the extracted keypoints are more distinctive and repeatable, which is beneficial to global registration. Finally, considering the difference in the imaging mechanism between SAR and optical images, this paper proposes a new sampling strategy that selects positive samples from the ground-truth position's neighborhood and augments negative samples by randomly sampling distractors in the corresponding image, which makes positive samples more accurate and negative samples more abundant. The experimental results show that the proposed method can significantly improve the accuracy of SAR–optical image registration. Compared to the existing conventional and deep learning methods, the proposed method yields a detector with better repeatability and a descriptor with stronger modality-invariant feature representation.

Multi-Source Remote Sensing Image Registration Based on Local Deep Learning Feature

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

Remote Sensing Image Registration Based on Multi-Head Self-Attention Mechanism

A Two-Stage Deep Learning Registration Method for Remote Sensing Images Based on Sub-Image Matching

An Image Registration Method Using Deep Residual Network Features for Multisource High-Resolution Remote Sensing Images

Analysis Of Feasibility And Advantages Of Multi-Source Image Registration Using Regional Features

A Novel Region-Based Image Registration Method for Multisource Remote Sensing Images Via CNN

Automatic Registration of Multi-source Remote Sensing Images Based on Region Growing

A Global-to-Local Algorithm for High-Resolution Optical and SAR Image Registration.

Multi-source Remote Sensing Image Registration Based on Contourlet Transform and Multiple Feature Fusion

An Instance Segmentation Based Framework for Large-Sized High-Resolution Remote Sensing Images Registration

SAR and Optical Image Registration Based on Deep Learning with Co-Attention Matching Module

Multi-Scale Fused SAR Image Registration Based on Deep Forest

A Fast and Fully Automatic Registration Approach Based on Point Features for Multi-Source Remote-Sensing Images

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

An Automatic Registration Based on Genetic Algorithm for Multi-Source Remote Sensing

Gradient Weakly Sensitive Multi-Source Sensor Image Registration Method

A multi-source remote sensing image registration algorithm based on local adaptive similarity analysis and improved cloud particle swarm model

Remote Sensing Image Registration Using Multiple Image Features

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration