Abstract:Optical and synthetic aperture radar (SAR) image registration is important for multimodal remote sensing image information fusion. Recently, deep matching networks have shown better performances than traditional methods of image matching. However, due to significant differences between optical and SAR images, the performances of existing deep learning methods still need to be further improved. This article proposes a self-distillation feature learning network (SDNet) for optical and SAR image registration, improving performance from network structure and network optimization. First, we explore the impact of different weight-sharing strategies on optical and SAR image matching. Then, we design a partially unshared feature learning network for multimodal image feature learning. It has fewer parameters than the fully unshared network and has more flexibility than the fully shared network. In addition, the limited binary supervised information (matching or nonmatching) is insufficient to train the deep matching networks for optical-SAR image registration. Thus, we propose a self-distillation feature learning method to exploit more similarity information for deep network optimization enhancement, such as the similarity ordering between a series of nonmatching patch pairs. The exploited rich similarity information will significantly enhance network training and improve matching accuracy. Finally, existing deep learning methods brute-force make the matching features of the optical and SAR image patches similar, which will lead to the loss of discriminative information and degeneration of the matching performances. Thus, we build an auxiliary task reconstruction learning to optimize the feature learning network to keep more discriminative information. Extensive experiments demonstrate the effectiveness of our proposed method on multimodal image registration.

A lightweight deep convolutional network with inverted residuals for matching optical and SAR images

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Optical and SAR Image Matching Using Pixelwise Deep Dense Features

Explore Better Network Framework for High-Resolution Optical and SAR Image Matching

SAR-Optical Image Matching by Integrating Siamese U-Net with FFT Correlation

Feature Matching and Position Matching Between Optical and SAR with Local Deep Feature Descriptor

Robust Optical and SAR Image Matching Using Attention-Enhanced Structural Features

Scene-Level Matching Between Remote Sensing Optical and SAR Images

A Novel Rotation and Scale Equivariant Network for Optical-SAR Image Matching

An Attention-Based Fusion for Handcrafted and Deep Feature to Improve Optical and SAR Image Matching

Self-Distillation Feature Learning Network for Optical and SAR Image Registration

Synthetic Aperture Radar and Optical Images Registration Based on Convolutional and Graph Neural Networks

SAR–Optical Image Matching Using Self-Supervised Detection and a Transformer–CNN-Based Network

Shared contents alignment across multiple granularities for robust SAR-optical image matching

SAR-optical Feature Matching: A Large-Scale Patch Dataset and a Deep Local Descriptor

Detector-Free Feature Matching for Optical and SAR Images Based on a Two-Step Strategy

Robust Matching for SAR and Optical Images Using Multiscale Convolutional Gradient Features

A Novel Loss Function for Optical and SAR Image Matching: Balanced Positive and Negative Samples

A Lightweight SAR Image Recognition Algorithm Based on Deep Convolutional Neural Network

Aerial image matching based on dynamic convolution and adaptive neighborhood consensus network