Abstract:Feature matching is a core step in multi-source remote sensing image registration approaches based on feature. However, for existing methods, whether traditional classical SIFT algorithm or deep learning-based methods, they essentially rely on generating descriptors from local regions of feature points, which can lead to low matching success rates due to various challenges, including gray-scale changes, content changes, local similarity, and occlusions between images. Inspired by the human approach of finding rough corresponding regions globally and then carefully comparing local regions, and the excellent global attention property of transformers, the proposed feature matching network adopts a coarse-to-fine matching strategy that utilizes both global and local information between images to predict corresponding feature points. Importantly, the network has great flexibility of matching corresponding points for any feature points and can be effectively trained without strong supervised signals of corresponding feature points and only require the true geometric transformation between images. The qualitative experiment illustrate the effectiveness of the proposed network by matching feature points extracted by SIFT or sampled uniformly. In the quantitative experiments, we used feature points extracted by SIFT, SuperPoint, and LoFTR as the keypoints to be matched. We then calculated the mean match success ratio (MSR) and mean reprojection error (MRE) of each method at different thresholds in the test dataset. Additionally, boxplot graphs were plotted to visualize the distributions. By comparing the MSR and MRE values as well as their distributions with other methods, we can conclude that the proposed method consistently outperforms the comparison methods in terms of MSR at different thresholds. Moreover, the MSR of the proposed method remains within a reasonable range compared to the MRE of other methods.

Spatially Coherent Matching for Robust Registration

SCM: Spatially Coherent Matching With Gaussian Field Learning for Nonrigid Point Set Registration

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Progressive Motion Coherence for Remote Sensing Image Matching

Robust Estimation of Nonrigid Transformation for Point Set Registration

Boosting Structure Consistency for Multispectral and Multimodal Image Registration

Feature Matching for Remote-Sensing Image Registration via Neighborhood Topological and Affine Consistency

Robust Image Feature Matching Via Progressive Sparse Spatial Consensus

Robust Feature Based Multisensor Remote Sensing Image Registration Algorithm

Remote Sensing Image Registration Based on Local Structural Information and Global Constraint

A New Method Based on Spatial Relations for Feature Matching

Fast and Robust Spatial Matching for Object Retrieval

Robust feature point matching based on geometric consistency and affine invariant spatial constraint

Robust Optical and SAR Image Registration Based on OS-SIFT and Cascaded Sample Consensus

A Robust Nonrigid Point Set Registration Method Based on Collaborative Correspondences

SC2-PCR: A Second Order Spatial Compatibility for Efficient and Robust Point Cloud Registration

Robust Feature Matching for Remote Sensing Image Registration Via Locally Linear Transforming

A Robust Multi-Source Remote-Sensing Image Registration Method Based on Feature Matching

Robust Non-Rigid Feature Matching for Image Registration Using Geometry Preserving

A Coarse-to-Fine Feature Match Network Using Transformers for Remote Sensing Image Registration.

A Simple and Robust Feature Point Matching Algorithm Based on Restricted Spatial Order Constraints for Aerial Image Registration