Abstract:Due to the complementary nature of optical and synthetic aperture radar (SAR) images, their alignment is of increasing interest. However, due to the significant radiometric differences between them, precise matching becomes a very challenging problem. Although current advanced structural features and deep learning-based methods have proposed feasible solutions, there is still much potential for improvement. In this article, we propose a hybrid matching method using attention-enhanced structural features (namely AESF), which combines the advantages of both handcrafted-based and learning-based methods to improve the accuracy of optical and SAR image matching. It mainly consists of two modules: a novel effective multibranch global attention (MBGA) module and a joint multicropping image matching loss function (MCTM) module. The MBGA module is designed to focus on shared information in structural feature descriptors of heterogeneous images across space and channel dimensions, significantly improving the expressive capacity of the classical structural features and generating more refined and robust image features. The MCTM module is constructed to fully exploit the association between global and local information of the input image, which can optimize the triple loss discriminator to discriminate between positive and negative samples. To validate the effectiveness of the proposed method, it is compared with five state-of-the-art matching methods by using various optical and SAR datasets. The experimental results show that the matching accuracy at the 1-pixel threshold is improved by about 1.8%–8.7% compared with the most advanced deep learning method (OSMNet) and 6.5%–23% compared with the handcrafted description method channel feature of orientated gradient (CFOG).

A High Performance Edge Point Feature Match Method of SAR Images

EEKHI–SAR–SIFT: Edge Enhancement and Keypoint Homogeneous Improved SAR–SIFT Framework Based on Unbiased Difference Ratio Edge Detector Strategy

Real-time and High Precision Feature Matching Between Blur Aerial Images

A SAR Image Registration Algorithm Using Edge Information Combined with Gray-Level Information

A Robust Multiscale Edge Detection Method for Accurate SAR Image Registration

A High Precision Feature Matching Method Based On Geometrical Outlier Removal For Remote Sensing Image Registration

SAR image matching algorithm based on multi-class features

Ratio-Based Edge Detection for SAR Imagery Using MAP Estimation and GGMRF Modeling

Research on Edge Detection for SAR Images

Detector-Free Feature Matching for Optical and SAR Images Based on a Two-Step Strategy

Generation of Pixel-Level Sar Image Time Series Using A Locally Adaptive Matching Technique

An Optimal Edge Detector for Bridge Target Detection in SAR Images

A New Cursory-to-exacted Matching Algorithm Based on Region of Interest for Flat and Water Area

SAR Image Registration with Sift Features and Edge Points

Robust Optical and SAR Image Matching Using Attention-Enhanced Structural Features

An Efficient and Precise Remote Sensing Optical Image Matching Technique Using Binary-Based Feature Points

Bayesian Edge Detector for SAR Imagery Using Discontinuity-Adaptive Markov Random Field Modeling

Sar-Pc: Edge Detection in Sar Images Via an Advanced Phase Congruency Model

A new method for target aspect estimation in SAR images

A Flexible Region of Interest Extraction Algorithm with Adaptive Threshold for 3-D Synthetic Aperture Radar Images

SAR Image Registration Based on ROEWA-Blocks and Multiscale Circle Descriptor