Abstract:Synthetic aperture radar (SAR) and optical images often present different geometric structures and texture features for the same ground object. Through the fusion of SAR and optical images, it can effectively integrate their complementary information, thus better meeting the requirements of remote sensing applications, such as target recognition, classification, and change detection, so as to realize the collaborative utilization of multi-modal images. In order to select appropriate methods to achieve high-quality fusion of SAR and optical images, this paper conducts a systematic review of current pixel-level fusion algorithms for SAR and optical image fusion. Subsequently, eleven representative fusion methods, including component substitution methods (CS), multiscale decomposition methods (MSD), and model-based methods, are chosen for a comparative analysis. In the experiment, we produce a high-resolution SAR and optical image fusion dataset (named YYX-OPT-SAR) covering three different types of scenes, including urban, suburban, and mountain. This dataset and a publicly available medium-resolution dataset are used to evaluate these fusion methods based on three different kinds of evaluation criteria: visual evaluation, objective image quality metrics, and classification accuracy. In terms of the evaluation using image quality metrics, the experimental results show that MSD methods can effectively avoid the negative effects of SAR image shadows on the corresponding area of the fusion result compared with CS methods, while model-based methods exhibit relatively poor performance. Among all of the fusion methods involved in the comparison, the non-subsampled contourlet transform method (NSCT) presents the best fusion results. In the evaluation using image classification, most experimental results show that the overall classification accuracy after fusion is better than that before fusion. This indicates that optical-SAR fusion can improve land classification, with the gradient transfer fusion method (GTF) yielding the best classification results among all of these fusion methods.

Mixed Fusion Algorithm of SAR and Visible Images with Feature Level and Pixel Level

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition

Comparative Analysis of Pixel-Level Fusion Algorithms and a New High-Resolution Dataset for SAR and Optical Image Fusion

Optical and SAR Image Fusion Based on Complementary Feature Decomposition and Visual Saliency Features

OPTICAL AND SAR IMAGE FUSION BASED ON VISUAL SALIENCY FEATURES

The Realistic Fusion of Multi-spectral Images

Pixel level fusion approach based on optimizing visual perception for multi-band SAR image

An Effective Multi-model Fusion Method for SAR and Optical Remote Sensing Images

An Image Fusion Method of SAR and Multispectral Images Based on Non-Subsampled Shearlet Transform and Activity Measure

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

A Visible and Synthetic Aperture Radar Image Fusion Algorithm Based on a Transformer and a Convolutional Neural Network

Target recognition of SAR images via hierarchical fusion of complementary features

Infrared and visible image fusion enhancement technology based on multi-scale directional analysis

Learning SAR-Optical Cross Modal Features for Land Cover Classification

SAR-image Enhancement and Fusion Based on Improved IHS Method

Multispectral and SAR Image Fusion Based on Laplacian Pyramid and Sparse Representation

An improved hybrid multiscale fusion algorithm based on NSST for infrared–visible images

Realizing Target Detection in SAR Images Based on Multiscale Superpixel Fusion