Abstract:Due to the modal disparities between synthetic aperture radar (SAR) and optical images, effectively extracting modality-shared structural features is crucial for achieving accurate registration results. Considering that point features have a limited ability to describe the common structural features between SAR and optical images, graph topology is introduced to extract edge features to derive modality-shared structural features for reliable registration. In this article, we propose a registration network for multifeature alignment and matching (MFAM-RegNet) between SAR and optical images, which includes a multifeature alignment module (MFAM) and a multifeature matching module (MFMM). First, we construct an MFAM to extract and align point and edge features to mine modality-shared structural features. In MFAM, point features are extracted by graph neural networks, and edge features are constructed by the feature similarity between two keypoints. Inspired by graph matching, we design linear and quadratic contrastive learning to mine the correspondence of point and edge features of intramodal and intermodal images. Second, speckle noise in SAR images inevitably leads to some noise labels, which decreases the accuracy and robustness of our supervised algorithm. Therefore, we design an MFMM to modify noise labels and use bidirectional matching for robust matching. According to the essential relationships of features mined by the momentum contrastive learning strategy, the labels are adaptively modified to reduce the influence of the incorrect labels on the model's performance and achieve more stable matching results. Experiments on three publicly available SAR and optical datasets indicate that our proposed MFAM-RegNet outperforms the existing state-of-the-art algorithms.

Multilevel Attention Siamese Network for Keypoint Detection in Optical and SAR Images

KAM-Net: Keypoint-Aware and Keypoint-Matching Network for Vehicle Detection from 2-D Point Cloud

Self-Supervised Keypoint Detection and Cross-Fusion Matching Networks for Multimodal Remote Sensing Image Registration

SAR–Optical Image Matching Using Self-Supervised Detection and a Transformer–CNN-Based Network

TSK: A Trustworthy Semantic Keypoint Detector for Remote Sensing Images

A Concurrent Multiscale Detector for End-to-End Image Matching

Dynamic Keypoint Detection Network for Image Matching

SK-Net: Deep Learning on Point Cloud via End-to-end Discovery of Spatial Keypoints

SEKD: Self-Evolving Keypoint Detection and Description

Explore Better Network Framework for High-Resolution Optical and SAR Image Matching

Multifeature Alignment and Matching Network for SAR and Optical Image Registration

Key Points Detection Algorithm of Object Based on Full Convolution Network

P2-Net - Joint Description and Detection of Local Features for Pixel and Point Matching.

RSKDD-Net: Random Sample-based Keypoint Detector and Descriptor

KASiam: Keypoints-Aligned Siamese Network for the Completion of Partial TLS Point Clouds

Multi-scale Dense Object Detection in Remote Sensing Imagery Based on Keypoints

Real-time CNN-based Keypoint Detector with Sobel Filter and Descriptor Trained with Keypoint Candidates

Multi-Level Feature Aggregation-Based Joint Keypoint Detection and Description

Feature Matching and Position Matching Between Optical and SAR with Local Deep Feature Descriptor

DGD-net - Local Descriptor Guided Keypoint Detection Network.

Semantic-Guided Attention Refinement Network for Salient Object Detection in Optical Remote Sensing Images