Abstract:Synthetic aperture radar (SAR) and optical images often present different geometric structures and texture features for the same ground object. Through the fusion of SAR and optical images, it can effectively integrate their complementary information, thus better meeting the requirements of remote sensing applications, such as target recognition, classification, and change detection, so as to realize the collaborative utilization of multi-modal images. In order to select appropriate methods to achieve high-quality fusion of SAR and optical images, this paper conducts a systematic review of current pixel-level fusion algorithms for SAR and optical image fusion. Subsequently, eleven representative fusion methods, including component substitution methods (CS), multiscale decomposition methods (MSD), and model-based methods, are chosen for a comparative analysis. In the experiment, we produce a high-resolution SAR and optical image fusion dataset (named YYX-OPT-SAR) covering three different types of scenes, including urban, suburban, and mountain. This dataset and a publicly available medium-resolution dataset are used to evaluate these fusion methods based on three different kinds of evaluation criteria: visual evaluation, objective image quality metrics, and classification accuracy. In terms of the evaluation using image quality metrics, the experimental results show that MSD methods can effectively avoid the negative effects of SAR image shadows on the corresponding area of the fusion result compared with CS methods, while model-based methods exhibit relatively poor performance. Among all of the fusion methods involved in the comparison, the non-subsampled contourlet transform method (NSCT) presents the best fusion results. In the evaluation using image classification, most experimental results show that the overall classification accuracy after fusion is better than that before fusion. This indicates that optical-SAR fusion can improve land classification, with the gradient transfer fusion method (GTF) yielding the best classification results among all of these fusion methods.

Fuse Spectropolarimetric Imagery by D-S Reasoning

Object Detection by Spectropolarimeteric Imagery Fusion

Imaging spectrometer image data fusion

The Method Of Infrared Polariametric Imaging

Unsupervised Spectropolarimetric Imagery Clustering Fusion

Multi-Dimensional Fusion of Spectral and Polarimetric Images Followed by Pseudo-Color Algorithm Integration and Mapping in HSI Space

Real-Time Polarization Spectral Detection Based on a Dual-Dispersion and Coded-Aperture Imaging System.

Objects Recognition Based on the Multi-Angle Polarization D-value Curve

Fusion Detection via Distance-Decay Intersection over Union and Weighted Dempster-Shafer Evidence Theory

Polar Cloud Detection of FengYun-3D Medium Resolution Spectral Imager II Imagery Based on the Radiative Transfer Model

Fusion Detection via Distance-Decay IoU and weighted Dempster-Shafer Evidence Theory

Adaptive Speckle Filter for Multi-Temporal PolSAR Image with Multi-Dimensional Information Fusion

POLARIMETRIC SCATTERING MODELING AND INFORMATION RETRIEVAL OF SAR REMOTE SENSING --- A REVIEW OF FDU WORK

Polarization image demosaicking based on homogeneity space

Comparative Analysis of Pixel-Level Fusion Algorithms and a New High-Resolution Dataset for SAR and Optical Image Fusion

An Image Fusion Method of SAR and Multispectral Images Based on Non-Subsampled Shearlet Transform and Activity Measure

[Research on Ground Feature’s Polarized Properties with Multi-Spectral and Multi-Angle AirMSPI Data].

Interferometric Phase Improvement Based on Polarimetric Data Fusion.

A New Fusion Method for Remote Sensing Images Based on Salient Region Extraction

Information Fusion Techniques for Change Detection from Multi-Temporal Remote Sensing Images.

Novel Model-Based Method for Identification of Scattering Mechanisms in Polarimetric SAR Data