Abstract:Synthetic aperture radar (SAR) and optical images often present different geometric structures and texture features for the same ground object. Through the fusion of SAR and optical images, it can effectively integrate their complementary information, thus better meeting the requirements of remote sensing applications, such as target recognition, classification, and change detection, so as to realize the collaborative utilization of multi-modal images. In order to select appropriate methods to achieve high-quality fusion of SAR and optical images, this paper conducts a systematic review of current pixel-level fusion algorithms for SAR and optical image fusion. Subsequently, eleven representative fusion methods, including component substitution methods (CS), multiscale decomposition methods (MSD), and model-based methods, are chosen for a comparative analysis. In the experiment, we produce a high-resolution SAR and optical image fusion dataset (named YYX-OPT-SAR) covering three different types of scenes, including urban, suburban, and mountain. This dataset and a publicly available medium-resolution dataset are used to evaluate these fusion methods based on three different kinds of evaluation criteria: visual evaluation, objective image quality metrics, and classification accuracy. In terms of the evaluation using image quality metrics, the experimental results show that MSD methods can effectively avoid the negative effects of SAR image shadows on the corresponding area of the fusion result compared with CS methods, while model-based methods exhibit relatively poor performance. Among all of the fusion methods involved in the comparison, the non-subsampled contourlet transform method (NSCT) presents the best fusion results. In the evaluation using image classification, most experimental results show that the overall classification accuracy after fusion is better than that before fusion. This indicates that optical-SAR fusion can improve land classification, with the gradient transfer fusion method (GTF) yielding the best classification results among all of these fusion methods.

Improved compressed sensing reconstruction algorithm and its application in image fusion

IEF-CSNET: Information Enhancement and Fusion Network for Compressed Sensing Reconstruction

Compressed Sensing Fourier Single Pixel Imaging Algorithm Based on Joint Discrete Gradient and Non-Local Self-Similarity Priors

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Image fusion in compressed sensing

Gradient-based Compressive Image Fusion

Research on GF-1 Remote Sensing IHS Image Fusion Algorithm Based on Compressed Sensing

Sparsity estimation based adaptive matching pursuit algorithm

Classification-based image-fusion framework for compressive imaging

An Improved Pigeon-Inspired Optimization for Multi-focus Noisy Image Fusion

Compressed Sensing Photoacoustic Imaging Based on Fast Alternating Direction Algorithm

Improving spatial domain based image formation through compressed sensing

PCNN-Based Image Fusion in Compressed Domain

Compressed sensing photoacoustic imaging based on the gradient projection Newton pursuit algorithm

Variable step size stagewise adaptive matching pursuit algorithm for image compressed sensing

FusionOpt-Net: A Transformer-Based Compressive Sensing Reconstruction Algorithm

The Improved Particle Swarm Optimization Algorithm Based Compressive Sensing

PIAFusion: A progressive infrared and visible image fusion network based on illumination aware

Comparative Analysis of Pixel-Level Fusion Algorithms and a New High-Resolution Dataset for SAR and Optical Image Fusion

An Optimized Inversion Method for Hyperspectral Image Fusion Based on a Hue–Intensity–Saturation, Wavelet, and Trust-Region Conjugate Gradient Method

Region-Based Image-Fusion Framework for Compressive Imaging