Abstract:The registration of synthetic aperture radar (SAR) and optical images is significant in obtaining their complementary information, which is a key prerequisite for image fusion. However, the inherent differences between the two modalities pose a challenge to the existing deep-learning algorithms that only depend on local features. To address this problem, we propose a global and local feature extraction network (GLFE-Net) for SAR and optical image registration. Beyond merely extracting local features to generate feature descriptors, more importantly, the network also extracts the global feature to better mine the common structural features between SAR and optical images. First, considering the ability of the transformer for long-range dependence and the advantages of convolutional neural network for local feature extraction, GLFE-Net designs two branches: one uses an attention-discarded global feature extraction transformer (ADG Transformer) to extract global features from the entire SAR and optical images, and another uses a partial convolution unit with parameter-free attention mechanism (PCU-AM) to extract local features from the patches around the keypoints. Then, the output features of the two branches are fused to obtain the final feature descriptor with more comprehensive features. Second, in order to establish accurate keypoints correspondence in the matching phase, hard-mean loss function is proposed to optimize GLFE-Net, which jointly utilizes hard negative samples and remaining negative samples to guide descriptors in learning more discriminant features to better distinguish positive and negative samples in SAR and optical images. Finally, the experimental results on the publicly available OS dataset and WHU-SEN-City demonstrate that our proposed GLFE-Net is superior to existing state-of-the-art methods with average root-mean-square error (aRMSE) reduced by 0.14.

Deep Generative Matching Network for Optical and SAR Image Registration

Deep convolutional GAN-based optical image and SAR image registration method

Registration of Multimodal Remote Sensing Image Based on Deep Fully Convolutional Neural Network

Multifeature Alignment and Matching Network for SAR and Optical Image Registration

Self-Distillation Feature Learning Network for Optical and SAR Image Registration

SAR and Optical Image Registration Based on Deep Learning with Co-Attention Matching Module

Multi-Feature Alignment and Matching Network for SAR and Optical Image Registration

Multimodal Remote Sensing Image Registration Based on Image Transfer and Local Features

A Global-to-Local Algorithm for High-Resolution Optical and SAR Image Registration.

A Fast and Robust Matching System for Multimodal Remote Sensing Image Registration

Deep Global Feature-Based Template Matching for Fast Multi-Modal Image Registration.

Explore Better Network Framework for High-Resolution Optical and SAR Image Matching

Optical and SAR Image Registration Based on Pseudo-SAR Image Generation Strategy

Synthetic aperture radar and optical image registration using local and global feature learning by modality-shared attention network

Self-Supervised Keypoint Detection and Cross-Fusion Matching Networks for Multimodal Remote Sensing Image Registration

Synthetic Aperture Radar and Optical Images Registration Based on Convolutional and Graph Neural Networks

Intra- and Inter-Modal Graph Attention Network and Contrastive Learning for SAR and Optical Image Registration

Fast and Robust Matching for Multimodal Remote Sensing Image Registration

Deep Feature Correlation Learning for Multi-Modal Remote Sensing Image Registration

Application of Deep Learning for Registration Between SAR and Optical Images

A Novel Dual-Branch Global and Local Feature Extraction Network for SAR and Optical Image Registration