Abstract:Synthetic aperture radar (SAR) and optical images often present different geometric structures and texture features for the same ground object. Through the fusion of SAR and optical images, it can effectively integrate their complementary information, thus better meeting the requirements of remote sensing applications, such as target recognition, classification, and change detection, so as to realize the collaborative utilization of multi-modal images. In order to select appropriate methods to achieve high-quality fusion of SAR and optical images, this paper conducts a systematic review of current pixel-level fusion algorithms for SAR and optical image fusion. Subsequently, eleven representative fusion methods, including component substitution methods (CS), multiscale decomposition methods (MSD), and model-based methods, are chosen for a comparative analysis. In the experiment, we produce a high-resolution SAR and optical image fusion dataset (named YYX-OPT-SAR) covering three different types of scenes, including urban, suburban, and mountain. This dataset and a publicly available medium-resolution dataset are used to evaluate these fusion methods based on three different kinds of evaluation criteria: visual evaluation, objective image quality metrics, and classification accuracy. In terms of the evaluation using image quality metrics, the experimental results show that MSD methods can effectively avoid the negative effects of SAR image shadows on the corresponding area of the fusion result compared with CS methods, while model-based methods exhibit relatively poor performance. Among all of the fusion methods involved in the comparison, the non-subsampled contourlet transform method (NSCT) presents the best fusion results. In the evaluation using image classification, most experimental results show that the overall classification accuracy after fusion is better than that before fusion. This indicates that optical-SAR fusion can improve land classification, with the gradient transfer fusion method (GTF) yielding the best classification results among all of these fusion methods.

The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXVIII-4/C7 CLASSIFICATION OF HIGH RESOLUTION OPTICAL AND SAR FUSION IMAGE USING FUZZY KNOWLEDGE AND OBJECT-ORIENTED PARADIGM

CLASSIFICATION OF HIGH RESOLUTION OPTICAL AND SAR FUSION IMAGE USING FUZZY KNOWLEDGE AND OBJECT-ORIENTED PARADIGM

A Novel Classification Method Based on Texture Analysis Using High-Resolution SAR and Optical Data

A Novel Remote Sensing Image Classification Scheme Based on Data Fusion, Multiple Features and Ensemble Learning

Classification of Land Cover from Remote Sensing Fused Image Based on ICA-SVM and D-S Evidence Theory

APPLICATION OF FUSION WITH SAR AND OPTICAL IMAGES IN LAND USE CLASSIFICATION BASED ON SVM

Comparative Analysis of Pixel-Level Fusion Algorithms and a New High-Resolution Dataset for SAR and Optical Image Fusion

The Study on Image Fusion for Medium and High Spatial Resolution Remote Sensing Images

Classification of High Spatial Resolution Remote Sensing Images Based on Decision Fusion

Analysis and Evaluation of IKONOS Image Fusion Algorithm Based on Land Cover Classification

Object-oriented Land Cover Classification of HJ-1B CCD Image Through Multiple Classifier Fusion.

Learning SAR-Optical Cross Modal Features for Land Cover Classification

A Zero Saturation Distortion Image Fusion Method Based on the GCOS Framework

TEXTURE ANALYSIS BASED FUSION EXPERIMENTS USING HIGH-RESOLUTION SAR AND OPTICAL IMAGERY

A New Image Fusion Algorithm Based on Classification

Optimization of Fusion Method for GF-2 Satellite Remote Sensing Images Based on the Classification Effect

OPTICAL AND SAR IMAGE FUSION BASED ON VISUAL SALIENCY FEATURES

A novel QIM-DCT based fusion approach for classification of remote sensing images via PSO and SVM models

Correlated Decision Fusion Accompanied with Quality Information on a Multi-Band Pixel Basis for Land Cover Classification

Optical and SAR Image Fusion Based on Complementary Feature Decomposition and Visual Saliency Features

Remote Sensing Image Fusion Based on Fuzzy Theory in Pixel Level and Assessing the Quality of Resulting Images