Abstract:Due to the complementary nature of optical and synthetic aperture radar (SAR) images, their alignment is of increasing interest. However, due to the significant radiometric differences between them, precise matching becomes a very challenging problem. Although current advanced structural features and deep learning-based methods have proposed feasible solutions, there is still much potential for improvement. In this article, we propose a hybrid matching method using attention-enhanced structural features (namely AESF), which combines the advantages of both handcrafted-based and learning-based methods to improve the accuracy of optical and SAR image matching. It mainly consists of two modules: a novel effective multibranch global attention (MBGA) module and a joint multicropping image matching loss function (MCTM) module. The MBGA module is designed to focus on shared information in structural feature descriptors of heterogeneous images across space and channel dimensions, significantly improving the expressive capacity of the classical structural features and generating more refined and robust image features. The MCTM module is constructed to fully exploit the association between global and local information of the input image, which can optimize the triple loss discriminator to discriminate between positive and negative samples. To validate the effectiveness of the proposed method, it is compared with five state-of-the-art matching methods by using various optical and SAR datasets. The experimental results show that the matching accuracy at the 1-pixel threshold is improved by about 1.8%–8.7% compared with the most advanced deep learning method (OSMNet) and 6.5%–23% compared with the handcrafted description method channel feature of orientated gradient (CFOG).

Study of the Automatic Matching Method for Optical and SAR Image

Real-time and High Precision Feature Matching Between Blur Aerial Images

A combined image matching method for Chinese optical satellite imagery.

Detector-Free Feature Matching for Optical and SAR Images Based on a Two-Step Strategy

A High Precision Feature Matching Method Based On Geometrical Outlier Removal For Remote Sensing Image Registration

Automatic Matching of Multi-Source Satellite Images: A Case Study on ZY-1-02C and ETM+

Automatic Optimization for Affine Invariant Feature Matching on Remote Sensing Imagery

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Robust Optical and SAR Image Matching Using Attention-Enhanced Structural Features

A Fast Local Stereo Matching Insensitive to Illumination Conditions

Optical and SAR Image Matching Using Pixelwise Deep Dense Features

A New Method for Remote Sensing Image Matching by Integrating Affine Invariant Feature Extraction and RANSAC

A New Cursory-to-exacted Matching Algorithm Based on Region of Interest for Flat and Water Area

Automatic Optical-to-SAR Image Registration by Iterative Line Extraction and Voronoi Integrated Spectral Point Matching

EEKHI–SAR–SIFT: Edge Enhancement and Keypoint Homogeneous Improved SAR–SIFT Framework Based on Unbiased Difference Ratio Edge Detector Strategy

A High Performance Edge Point Feature Match Method of SAR Images

An Efficient and Precise Remote Sensing Optical Image Matching Technique Using Binary-Based Feature Points

A Fast Matching Method for the SAR Images with Large Viewing Angles Based on Inertial Navigation Information and Neighborhood Structure Consensus

A Robust Multisource Remote Sensing Image Matching Method Utilizing Attention and Feature Enhancement Against Noise Interference

Comparative Analysis of Advanced Feature Matching Algorithms in Challenging High Spatial Resolution Optical Satellite Stereo Scenarios

SAR image matching algorithm based on multi-class features