Abstract:Synthetic aperture radar (SAR) and optical images often present different geometric structures and texture features for the same ground object. Through the fusion of SAR and optical images, it can effectively integrate their complementary information, thus better meeting the requirements of remote sensing applications, such as target recognition, classification, and change detection, so as to realize the collaborative utilization of multi-modal images. In order to select appropriate methods to achieve high-quality fusion of SAR and optical images, this paper conducts a systematic review of current pixel-level fusion algorithms for SAR and optical image fusion. Subsequently, eleven representative fusion methods, including component substitution methods (CS), multiscale decomposition methods (MSD), and model-based methods, are chosen for a comparative analysis. In the experiment, we produce a high-resolution SAR and optical image fusion dataset (named YYX-OPT-SAR) covering three different types of scenes, including urban, suburban, and mountain. This dataset and a publicly available medium-resolution dataset are used to evaluate these fusion methods based on three different kinds of evaluation criteria: visual evaluation, objective image quality metrics, and classification accuracy. In terms of the evaluation using image quality metrics, the experimental results show that MSD methods can effectively avoid the negative effects of SAR image shadows on the corresponding area of the fusion result compared with CS methods, while model-based methods exhibit relatively poor performance. Among all of the fusion methods involved in the comparison, the non-subsampled contourlet transform method (NSCT) presents the best fusion results. In the evaluation using image classification, most experimental results show that the overall classification accuracy after fusion is better than that before fusion. This indicates that optical-SAR fusion can improve land classification, with the gradient transfer fusion method (GTF) yielding the best classification results among all of these fusion methods.

Superpixel-based time-series reconstruction for optical images incorporating SAR data using autoencoder networks

For-backward LSTM-based missing data reconstruction for time-series Landsat images

Reconstruction of Optical Image Time Series With Unequal Lengths SAR Based on Improved Sequence–Sequence Model

Fusion of optical and SAR images based on deep learning to reconstruct vegetation NDVI time series in cloud-prone regions

Multi-scale Restoration of Missing Data in Optical Time-series Images with Masked Spatial-Temporal Attention Network

Cloud Removal of Optical Remote Sensing Imageries using SAR Data and Deep Learning

Generation of Pixel-Level Sar Image Time Series Using A Locally Adaptive Matching Technique

Spatiotemporal Fuzzy Clustering Strategy for Urban Expansion Monitoring Based on Time Series of Pixel-Level Optical and SAR Images

Cloud Removal With SAR-Optical Data Fusion Using a Unified Spatial–Spectral Residual Network

Pixel-Wise Attention Residual Network for Super-Resolution of Optical Remote Sensing Images.

A deep-learning reconstruction method for remote sensing images with large thick cloud cover

Cloud Removal for Optical Images Using SAR Structure Data

SAR Image Classification Using Fully Connected Conditional Random Fields Combined with Deep Learning and Superpixel Boundary Constraint

Integrating Multitemporal SAR and Optical Information for Missing Optical Imagery Generation

Comparative Analysis of Pixel-Level Fusion Algorithms and a New High-Resolution Dataset for SAR and Optical Image Fusion

Efficient Cloud Removal Network for Satellite Images Using SAR-Optical Image Fusion

Deep Learning for Integrated Speckle Reduction and Super-Resolution in Multi-Temporal SAR

Algorithm for cloud removal in optical-synthetic aperture radar fusion images based on improved residual networks

Research on Modeling Method for Pixel-Level SAR Image Time Series

Multi-Temporal Sentinel-1 and -2 Data Fusion for Optical Image Simulation