Abstract:Considering that deep learning achieves the prominent performance, it has been applied to synthetic aperture radar (SAR) image registration to improve the registration accuracy. In most methods, a deep registration model is constructed to classify matched points and unmatched points, in which SAR image registration is regarded as a supervised two-classification problem. However, it is difficult to annotate massive matched points manually in practice, which limits the performance of deep networks. Besides, inevitable differences among SAR images easily cause that some training and testing samples are inconsistent, which probably brings negative effects for training a robust registration model. To address these problems, we propose an adaptive self-supervised SAR image registration method, where SAR image registration is regarded as a self-supervised task rather than the supervised two-classification task. Inspired by self-supervised learning, we consider each point on SAR images as a category-independent instance, which mitigates the requirement of manual annotations. Based on key points from images, a self-supervised model is constructed to explore the latent feature of each key point, and then, pairs of match points are sought via evaluating similarities among key points and used to calculate the alignment transformation matrix. Meanwhile, to enhance the consistency of samples, we design a new strategy that constructs multiscale samples by transforming key points from one image into another, which avoids inevitable diversities between two images effectively. In particular, the constructed samples feeding to the self-supervised model are adaptively updated with the modification of the transformation matrix in iterations. Moreover, the similarity of maximal public areas (MPAS) indicator is proposed to assist in estimating the transformation. Finally, experimental results illustrate that the proposed method achieves more accurate registrations than other compared methods.

Remote Sensing Image Registration Based on Multi-Head Self-Attention Mechanism

A Deep Learning Framework for Remote Sensing Image Registration

A Two-Stage Deep Learning Registration Method for Remote Sensing Images Based on Sub-Image Matching

A Semi-Supervised Image Registration Framework Based on Multimodal Cross-Attention

Multimodal Remote Sensing Image Registration Based on Image Transfer and Local Features

Multi-Source Remote Sensing Image Registration Based on Local Deep Learning Feature

A Hybrid Method for Multi-sensor Remote Sensing Image Registration Based on Salience Region

Multi-sensor Image Registration by Combining Local Self-Similarity Matching and Mutual Information

An Image Registration Method Using Deep Residual Network Features for Multisource High-Resolution Remote Sensing Images

Self-Supervised Keypoint Detection and Cross-Fusion Matching Networks for Multimodal Remote Sensing Image Registration

SAR and Optical Image Registration Based on Deep Learning with Co-Attention Matching Module

Remote Sensing Image Registration Based on Multifeature and Region Division

A New Fast Multi-Source Remote Sensing Image Registration Algorithm

A Fast and Robust Matching System for Multimodal Remote Sensing Image Registration

Unsupervised Multimodal Remote Sensing Image Registration Via Domain Adaptation

Adaptive Self-Supervised SAR Image Registration With Modifications of Alignment Transformation

A Coarse-to-fine Image Registration Method Based on Visual Attention Model.

A Novel Two-Step Registration Method for Remote Sensing Images Based on Deep and Local Features

A Fast and Fully Automatic Registration Approach Based on Point Features for Multi-Source Remote-Sensing Images

Multi-Modal Image Registration Based on Local Self-Similarity and Bidirectional Matching

Multimodal Remote Sensing Image Registration Methods and Advancements: A Survey