Abstract:Seeking good feature correspondences between two remote sensing (RS) images is an essential and important problem in the fields of RS and photogrammetry. Traditional approaches often necessitate a predefined geometric transformation model or additional manually crafted descriptors, significantly constraining the versatility. In this work, we adopt the recent context structure representation network (CSR-Net), which has shown promising performance in general feature matching problems, and propose modifications, named CSR-Net++, to overcome its main limitations. Specifically, CSR-Net is combined with a PointNet-like geometry estimator, which is sensitive to large deformations, for global preregistration. In addition, CSR-Net learns local consensus representation through a fixed-size grid, leading to limited space-aware capacities due to grid pixelwise max-pooling operations. To tackle the abovementioned limitations, we first introduce a pruning layer for matching guided by global consensus, as opposed to relying on a geometric estimator. In addition, for directly learning consensus representation from points, we propose a modified context structure representation (CSR) learning module including an independent spatial location stream and a stand-alone visual stream (VS). This decomposition separates local consensus into positional consensus and visual consensus. The proposed dual-stream representation learning not only avoids the introduction of grid anchors but also provides visual contextual priors. To demonstrate the robustness and versatility of our CSR-Net++, we conducted comprehensive experiments using diverse sets of real image pairs for general feature matching. The results demonstrate the superiority of our CSR-Net++ in most matching scenarios, achieving a 0.47%-4.70% improvement in F-score for multimodal images over existing leading methods.

Sampling Consensus by Neighborhood Interaction Information for Remote Sensing Image Matching

Extended Neighborhood Consensus With Affine Correspondence for Outlier Filtering in Feature Matching

A High Precision Feature Matching Method Based On Geometrical Outlier Removal For Remote Sensing Image Registration

2-Entity Random Sample Consensus for Robust Visual Localization: Framework, Methods, and Verifications

Reliable RANSAC using a novel preprocessing model.

CSR-Net++: Rethinking Context Structure Representation Learning for Feature Matching

A Hierarchical Consensus Attention Network for Feature Matching of Remote Sensing Images

Mismatching Removal for Feature-Point Matching Based on Triangular Topology Probability Sampling Consensus

A Novel Image Registration Method Based on Geometrical Outlier Removal

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

A New Method for Remote Sensing Image Matching by Integrating Affine Invariant Feature Extraction and RANSAC

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

An Accurate and Robust Registration Framework Based on Outlier Removal and Feature Point Adjustment for Remote Sensing Images

A Robust Multisource Remote Sensing Image Matching Method Utilizing Attention and Feature Enhancement Against Noise Interference

Feature Matching for Remote-Sensing Image Registration via Neighborhood Topological and Affine Consistency

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration

Reliable and Efficient UAV Image Matching via Geometric Constraints Structured by Delaunay Triangulation

Learning Relaxed Neighborhood Consistency for Feature Matching

A Fast Matching Method for the SAR Images with Large Viewing Angles Based on Inertial Navigation Information and Neighborhood Structure Consensus

GLoCNet: Robust Feature Matching With Global–Local Consistency Network for Remote Sensing Image Registration