Abstract:The complementarity of synthetic aperture radar (SAR) and optical images allows remote sensing observations to "see" unprecedented discoveries. Image matching plays a fundamental role in the fusion and application of SAR and optical images. However, both the geometric imaging pattern and the physical radiation mechanism of these two sensors are significantly different, so that the images show complex geometric distortion and nonlinear radiation differences. This phenomenon brings great challenges to image matching, which neither the handcrafted descriptors nor the deep learning-based methods have adequately addressed. In this article, a novel image-based matching method for SAR to optical images via an image-based convolutional network with spatial pyramid aggregated pooling (SPAP) and an attention mechanism is proposed, namely MAP-Net. The original image is embedded through the convolutional neural network to generate the feature map. Through the information extraction and abstraction of the original imagery, the embedded features containing the high-level semantic information are more robust to the geometric distortion and radiation variation among the different modal images, which is beneficial to the matching of cross-modal images. The adoption of the SPAP module makes the network more capable of integrating global and local contextual information. The attention block weights the dense features generated from the network to extract the key features that are invariant, distinguishable, repeatable, and suitable for the image matching task. In the experiments, five sets of multisource and multiresolution SAR and optical images with wide and varied ground coverage were used to evaluate the accuracy of MAP-Net, compared to both handcrafted and deep learning-based methods. The experimental results show that the MAP-Net method is superior to the current state-of-the-art image matching methods for SAR to optical images.

Area Matching Suitability for SAR-image Matching Aided Navigation

A new stereo matching algorithm for UAV autonomous navigation

A New Cursory-to-exacted Matching Algorithm Based on Region of Interest for Flat and Water Area

Classification for SAR Scene Matching Areas Based on Convolutional Neural Networks.

SAR image matching algorithm based on multi-class features

A Fast Matching Method for the SAR Images with Large Viewing Angles Based on Inertial Navigation Information and Neighborhood Structure Consensus

Scene Matching Navigation for UAV Based on Spatial Relationship Geometric Constraints

A High Performance Edge Point Feature Match Method of SAR Images

Optimizing Matching Area for Underwater Gravity-Aided Inertial Navigation Based on the Convolution Slop Parameter-Support Vector Machine Combined Method

Detector-Free Feature Matching for Optical and SAR Images Based on a Two-Step Strategy

MAP-Net: SAR and Optical Image Matching via Image-Based Convolutional Network With Attention Mechanism and Spatial Pyramid Aggregated Pooling

Generation of Pixel-Level Sar Image Time Series Using A Locally Adaptive Matching Technique

A combined image matching method for Chinese optical satellite imagery.

Automatic Matching of Multi-Source Satellite Images: A Case Study on ZY-1-02C and ETM+

Dense Matching Method for UAV SAR Images Without Epipolar Rectification

Robust Optical and SAR Image Matching Using Attention-Enhanced Structural Features

Learning to Find the Optimal Correspondence Between SAR and Optical Image Patches

A Heterogeneous Remote Sensing Image Matching Method for Urban Areas With Complex Terrain Based on 3D Spatial Relationship Constraints

Underwater terrain-matching algorithm based on improved iterative closest contour point algorithm

Automatic Optimization for Affine Invariant Feature Matching on Remote Sensing Imagery

Unsupervised SAR and Optical Image Matching Using Siamese Domain Adaptation