Abstract:Abstract. With the expansion of optical and SAR image fusion application scenarios, it is necessary to integrate their information in land classification, feature recognition, and target tracking. Current methods focus excessively on integrating multimodal feature information to enhance the information richness of the fused images, while neglecting the highly corrupted visual perception of the fused results by modal differences and SAR speckle noise. To address this problem, in this paper we propose a novel optical and SAR image fusion framework named Visual Saliency Features Fusion (VSFF). We improved the decomposition algorithm of complementary feature to reduce most of the speckle noise in the initial features, and divide the image into main structure features and detail texture features. For the fusion of main structure features, we reconstruct a visual saliency features map that contains significant information from optical and SAR images, and input it together with the optical image into a total variation constraint model to compute the fusion result and achieve the optimal information transfer. Meanwhile, we construct a new feature descriptor based on Gabor wavelet, which separates meaningful detail texture features from residual noise and selectively preserves features that can improve the interpretability of fusion result. Further a fast IHS transform fusion is used to supplement the fused image with realistic color information. In a comparative analysis with five state-of-the-art fusion algorithms, VSFF achieved better results in qualitative and quantitative evaluations, and our fused images have a clear and appropriate visual perception.

Remote Sensing Image Fusion Algorithm Based on Mutual-Structure for Joint Filtering Using Saliency Detection.

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Dual Band Image Fusion Method Based on Region Saliency

An improved remote sensing image fusion method

A Novel Remote-Sensing Image Fusion Method Based on Hybrid Visual Saliency Analysis

Multi-Sensor Image Fusion: A Survey of the State of the Art

A New Saliency-Driven Fusion Method Based on Complex Wavelet Transform for Remote Sensing Images

Saliency-Guided Nonsubsampled Shearlet Transform for Multisource Remote Sensing Image Fusion

OPTICAL AND SAR IMAGE FUSION BASED ON VISUAL SALIENCY FEATURES

Image Fusion Method Based on Structure-Based Saliency Map and FDST-PCNN Framework.

Adaptive fractional multi-scale edge-preserving decomposition and saliency detection fusion algorithm

A New Fusion Method for Remote Sensing Images Based on Salient Region Extraction

Remote Sensing Image Fusion Algorithm Based on Multi-Feature

Multicontourlet-Based Adaptive Fusion of Infrared and Visible Remote Sensing Images

Multi-scale Image Fusion Through Rolling Guidance Filter.

Multimodal Image Seamless Fusion

Multi-modal remote sensing image fusion method guided by local extremum maps-guided image filter

Microscopy Image Fusion Algorithm Based on Saliency Analysis and Adaptive M-Pulse-coupled Neural Network in Non-Subsampled Contourlet Transform Domain

Remote Sensing Image Fusion Based on Nonlinear IHS and Fast Nonsubsampled Contourlet Transform

Infrared and Visible Image Fusion Based on Saliency Detection Dynamic Threshold Neural P Systems in Non-Subsampled Shearlet Transform Domain