Abstract:Due to the complementary nature of optical and synthetic aperture radar (SAR) images, their alignment is of increasing interest. However, due to the significant radiometric differences between them, precise matching becomes a very challenging problem. Although current advanced structural features and deep learning-based methods have proposed feasible solutions, there is still much potential for improvement. In this article, we propose a hybrid matching method using attention-enhanced structural features (namely AESF), which combines the advantages of both handcrafted-based and learning-based methods to improve the accuracy of optical and SAR image matching. It mainly consists of two modules: a novel effective multibranch global attention (MBGA) module and a joint multicropping image matching loss function (MCTM) module. The MBGA module is designed to focus on shared information in structural feature descriptors of heterogeneous images across space and channel dimensions, significantly improving the expressive capacity of the classical structural features and generating more refined and robust image features. The MCTM module is constructed to fully exploit the association between global and local information of the input image, which can optimize the triple loss discriminator to discriminate between positive and negative samples. To validate the effectiveness of the proposed method, it is compared with five state-of-the-art matching methods by using various optical and SAR datasets. The experimental results show that the matching accuracy at the 1-pixel threshold is improved by about 1.8%–8.7% compared with the most advanced deep learning method (OSMNet) and 6.5%–23% compared with the handcrafted description method channel feature of orientated gradient (CFOG).

Rank-Based Local Self-Similarity Descriptor for Optical-to-SAR Image Matching

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

Feature Matching and Position Matching Between Optical and SAR with Local Deep Feature Descriptor

OMIRD: Orientated Modality Independent Region Descriptor for Optical-to-SAR Image Matching

SAR-optical Feature Matching: A Large-Scale Patch Dataset and a Deep Local Descriptor

Automatic Registration Algorithm for SAR and Optical Images Based on Shearlet and Sparse Representation.

A New Local Feature Descriptor For Sar Image Matching

Template Coarse Matching of SAR and Optical Images Based on Wavelet Subbands and Hausdorff Distance

Robust Image Similarity Metric Method for SAR Images

Cosine Similarity Template Matching Networks for Optical and SAR Image Registration

SAR Image Processing Based on Similarity Measures and Discriminant Feature Learning

Scene-Level Matching Between Remote Sensing Optical and SAR Images

Robust Optical and SAR Image Matching Using Attention-Enhanced Structural Features

Towards Better Understanding of SAR Image: Feature Enhancement Via Non-Local and Low-Rank Approach

LSOD: Local Sparse Orthogonal Descriptor for Image Matching

SAR and Optical Image Matching Eased on Phase Congruency and Template Matching

A Novel Rotation and Scale Equivariant Network for Optical-SAR Image Matching

Optical and SAR Image Matching Using Pixelwise Deep Dense Features

Dense Remote Sensing Image Registration in Complex Terrain Areas Based on Feature Descriptors

SAR-Optical Image Matching by Integrating Siamese U-Net with FFT Correlation