Abstract:Feature matching is a core step in multi-source remote sensing image registration approaches based on feature. However, for existing methods, whether traditional classical SIFT algorithm or deep learning-based methods, they essentially rely on generating descriptors from local regions of feature points, which can lead to low matching success rates due to various challenges, including gray-scale changes, content changes, local similarity, and occlusions between images. Inspired by the human approach of finding rough corresponding regions globally and then carefully comparing local regions, and the excellent global attention property of transformers, the proposed feature matching network adopts a coarse-to-fine matching strategy that utilizes both global and local information between images to predict corresponding feature points. Importantly, the network has great flexibility of matching corresponding points for any feature points and can be effectively trained without strong supervised signals of corresponding feature points and only require the true geometric transformation between images. The qualitative experiment illustrate the effectiveness of the proposed network by matching feature points extracted by SIFT or sampled uniformly. In the quantitative experiments, we used feature points extracted by SIFT, SuperPoint, and LoFTR as the keypoints to be matched. We then calculated the mean match success ratio (MSR) and mean reprojection error (MRE) of each method at different thresholds in the test dataset. Additionally, boxplot graphs were plotted to visualize the distributions. By comparing the MSR and MRE values as well as their distributions with other methods, we can conclude that the proposed method consistently outperforms the comparison methods in terms of MSR at different thresholds. Moreover, the MSR of the proposed method remains within a reasonable range compared to the MRE of other methods.

Self-Supervised Keypoint Detection and Cross-Fusion Matching Networks for Multimodal Remote Sensing Image Registration

Heterogeneous self-supervised interest point matching for multi-modal remote sensing image registration

A Semi-Supervised Image Registration Framework Based on Multimodal Cross-Attention

Cross-view Matching Neural Network for Remote Sensing Images.

Registration of Multimodal Remote Sensing Image Based on Deep Fully Convolutional Neural Network

Multimodal Remote Sensing Image Registration Based on Image Transfer and Local Features

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

An Adaptive Remote Sensing Image-Matching Network Based on Cross Attention and Deformable Convolution

Multimodal Remote Sensing Image Matching via Learning Features and Attention Mechanism

A Coarse-to-Fine Feature Match Network Using Transformers for Remote Sensing Image Registration.

Remote Sensing Image Registration Based on Multi-Head Self-Attention Mechanism

A Two-Stage Deep Learning Registration Method for Remote Sensing Images Based on Sub-Image Matching

Robust Multimodal Remote Sensing Image Registration Based on Local Statistical Frequency Information

Multimodal Remote Sensing Image Matching Combining Learning Features and Delaunay Triangulation

Multi-sensor Image Registration by Combining Local Self-Similarity Matching and Mutual Information

A Fast and Robust Matching System for Multimodal Remote Sensing Image Registration

An Image Registration Method Using Deep Residual Network Features for Multisource High-Resolution Remote Sensing Images

A Concurrent Multiscale Detector for End-to-End Image Matching

Deep Generative Matching Network for Optical and SAR Image Registration

Multilevel Attention Siamese Network for Keypoint Detection in Optical and SAR Images