Abstract:Synthetic aperture radar (SAR) and optical images often present different geometric structures and texture features for the same ground object. Through the fusion of SAR and optical images, it can effectively integrate their complementary information, thus better meeting the requirements of remote sensing applications, such as target recognition, classification, and change detection, so as to realize the collaborative utilization of multi-modal images. In order to select appropriate methods to achieve high-quality fusion of SAR and optical images, this paper conducts a systematic review of current pixel-level fusion algorithms for SAR and optical image fusion. Subsequently, eleven representative fusion methods, including component substitution methods (CS), multiscale decomposition methods (MSD), and model-based methods, are chosen for a comparative analysis. In the experiment, we produce a high-resolution SAR and optical image fusion dataset (named YYX-OPT-SAR) covering three different types of scenes, including urban, suburban, and mountain. This dataset and a publicly available medium-resolution dataset are used to evaluate these fusion methods based on three different kinds of evaluation criteria: visual evaluation, objective image quality metrics, and classification accuracy. In terms of the evaluation using image quality metrics, the experimental results show that MSD methods can effectively avoid the negative effects of SAR image shadows on the corresponding area of the fusion result compared with CS methods, while model-based methods exhibit relatively poor performance. Among all of the fusion methods involved in the comparison, the non-subsampled contourlet transform method (NSCT) presents the best fusion results. In the evaluation using image classification, most experimental results show that the overall classification accuracy after fusion is better than that before fusion. This indicates that optical-SAR fusion can improve land classification, with the gradient transfer fusion method (GTF) yielding the best classification results among all of these fusion methods.

Information-theoretic heterogeneity analysis for evaluating the performances of sar image fusion techniques

A Novel Speckle Filter for Sar Images Based on Information- Theoretic Heterogeneity Measurements

Research on Image Fusion of SAR and Optical Image Based on Complementary Information Characteristics

Performance assessment of image fusion

Evaluation and analysis of fusion algorithms for active and passive remote sensing image.

Review on Heterogeneity Measurement of Synthetic Aperture Radar Imagery with Complex Scenario

A fast method to evaluate the performances of image fusion techniques and its error analysis

Image Fusion of SAR Remote Sensing with Laplacian Pyramid Transformation Fusion Algorithm Based on Local Conditional Information of Image

The Realistic Fusion of Multi-spectral Images

Comprehensive Evaluation for Fused Images of Multispectral and Panchromatic Images Based on Entropy Weight Method

Performances evaluation of image fusion techniques based on nonlinear correlation measurement

Quantitative Evaluation For Compact Polarimetric Sar Image Reconstruction Based On Information-Theoretic Analysis

Evaluation Method of Jamming Effect on ISAR Based on Image Entropy

An Image Fusion Method of SAR and Multispectral Images Based on Non-Subsampled Shearlet Transform and Activity Measure

ISAR image fusion based on mutual information techinque used multi-receivers

Comparative Analysis of Pixel-Level Fusion Algorithms and a New High-Resolution Dataset for SAR and Optical Image Fusion

SAR and Multispectral Image Fusion Using Generalized IHS Transform Based on à Trous Wavelet and EMD Decompositions

A New Method for Evaluation of Jamming Effect on ISAR

Remote sensing image fusion algorithm based on à trous wavelet transform and HIS transform

Multi-spectral and Panchromatic Image Fusion Based on Local Information Entropy and Its Distribution Property

Hyperspectral Image Multiresolution Fusion Based On Local Information Entropy