Abstract:Abstract. With the expansion of optical and SAR image fusion application scenarios, it is necessary to integrate their information in land classification, feature recognition, and target tracking. Current methods focus excessively on integrating multimodal feature information to enhance the information richness of the fused images, while neglecting the highly corrupted visual perception of the fused results by modal differences and SAR speckle noise. To address this problem, in this paper we propose a novel optical and SAR image fusion framework named Visual Saliency Features Fusion (VSFF). We improved the decomposition algorithm of complementary feature to reduce most of the speckle noise in the initial features, and divide the image into main structure features and detail texture features. For the fusion of main structure features, we reconstruct a visual saliency features map that contains significant information from optical and SAR images, and input it together with the optical image into a total variation constraint model to compute the fusion result and achieve the optimal information transfer. Meanwhile, we construct a new feature descriptor based on Gabor wavelet, which separates meaningful detail texture features from residual noise and selectively preserves features that can improve the interpretability of fusion result. Further a fast IHS transform fusion is used to supplement the fused image with realistic color information. In a comparative analysis with five state-of-the-art fusion algorithms, VSFF achieved better results in qualitative and quantitative evaluations, and our fused images have a clear and appropriate visual perception.

Color and motion information fusion based saliency filter for video

Video Saliency Detection Using Motion Saliency Filter

Color boosted visual saliency detection and its application to image classification

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Multi-window visual saliency extraction for fusion of visible and infrared images

Video Saliency Detection Using Dynamic Fusion of Spatial-Temporal Features in Complex Background with Disturbance

Nonlocal Feature Transform with Iterative Refinement for Video Saliency Detection

Video Saliency Detection Algorithm Based on Motion Spectral Residual

Multisensor video fusion based on spatial-temporal salience detection

Predictive Video Saliency Detection.

Video Saliency Detection via Dynamic Consistent Spatio-Temporal Attention Modelling.

Efficient Saliency Detection Based on Gaussian Models

Infrared and visible image fusion method based on visual saliency objects and fuzzy region attributes

OPTICAL AND SAR IMAGE FUSION BASED ON VISUAL SALIENCY FEATURES

Human Vision Attention Mechanism-Inspired Temporal-Spatial Feature Pyramid for Video Saliency Detection

Adaptive fractional multi-scale edge-preserving decomposition and saliency detection fusion algorithm

Motion-Aware Rapid Video Saliency Detection

Video saliency detection based on robust seeds generation and spatio-temporal propagation

A biologically inspired computational model for image saliency detection.

A novel visual saliency detection method for infrared video sequences