Abstract:Synthetic aperture radar (SAR) and optical images often present different geometric structures and texture features for the same ground object. Through the fusion of SAR and optical images, it can effectively integrate their complementary information, thus better meeting the requirements of remote sensing applications, such as target recognition, classification, and change detection, so as to realize the collaborative utilization of multi-modal images. In order to select appropriate methods to achieve high-quality fusion of SAR and optical images, this paper conducts a systematic review of current pixel-level fusion algorithms for SAR and optical image fusion. Subsequently, eleven representative fusion methods, including component substitution methods (CS), multiscale decomposition methods (MSD), and model-based methods, are chosen for a comparative analysis. In the experiment, we produce a high-resolution SAR and optical image fusion dataset (named YYX-OPT-SAR) covering three different types of scenes, including urban, suburban, and mountain. This dataset and a publicly available medium-resolution dataset are used to evaluate these fusion methods based on three different kinds of evaluation criteria: visual evaluation, objective image quality metrics, and classification accuracy. In terms of the evaluation using image quality metrics, the experimental results show that MSD methods can effectively avoid the negative effects of SAR image shadows on the corresponding area of the fusion result compared with CS methods, while model-based methods exhibit relatively poor performance. Among all of the fusion methods involved in the comparison, the non-subsampled contourlet transform method (NSCT) presents the best fusion results. In the evaluation using image classification, most experimental results show that the overall classification accuracy after fusion is better than that before fusion. This indicates that optical-SAR fusion can improve land classification, with the gradient transfer fusion method (GTF) yielding the best classification results among all of these fusion methods.

Fusion of Features in Multi-Temporal SAR Imagery to Detect Changes in Urban Areas

Fusion of Difference Images for Change Detection over Urban Areas

Change Detection in Multi-Temporal SAR Images Based on Slow Feature Analysis Combined With Improving Image Fusion Strategy

Improving Urban Land Cover Mapping with the Fusion of Optical and SAR Data Based on Feature Selection Strategy

Change Detection in Multitemporal SAR Images Based on Slow Feature Analysis Combined with Improving Image Fusion Strategy

Integrating bi-temporal VHR optical and long-term SAR images for built-up area change detection

Automatic Feature-Based Geometric Fusion of Multiview TomoSAR Point Clouds in Urban Area

Comparative Analysis of Pixel-Level Fusion Algorithms and a New High-Resolution Dataset for SAR and Optical Image Fusion

Information Fusion Techniques for Change Detection from Multi-Temporal Remote Sensing Images.

An Image Fusion Method of SAR and Multispectral Images Based on Non-Subsampled Shearlet Transform and Activity Measure

Change Detection from Multi-Temporal Remote Sensing Images by Integrating Multiple Features

Automatic Analysis of Change Detection of Multi-Temporal ERS-2 SAR Images by Using Two-Threshold EM and MRF Algorithms

Adaptive Contourlet Fusion Clustering for SAR Image Change Detection

A Multi-Scale Graph Based on Spatio-Temporal-Radiometric Interaction for SAR Image Change Detection

Building detection in SAR images based on fusion of classic and deep learning features

THE BP-ANN-GA ALGORITHM FOR DATA FUSION OF LANDSAT ETM AND ERS SAR IN URBAN AREA

Multidirectional Attention Fusion Network for SAR Change Detection

Urban object detection algorithm based on feature enhancement and progressive dynamic aggregation strategy

Improving Landsat ETM+ Urban Area Mapping Via Spatial and Angular Fusion with MISR Multi-Angle Observations

A TWO-THRESHOLDS EM-MRF ALGORITHM FOR CHANGE DETECTION OF MULTI-TEMPORAL ERS-2 SAR IMAGES

Extracting urban impervious surface based on optical and SAR images cross-modal multi-scale features fusion network