Abstract:Abstract. With the expansion of optical and SAR image fusion application scenarios, it is necessary to integrate their information in land classification, feature recognition, and target tracking. Current methods focus excessively on integrating multimodal feature information to enhance the information richness of the fused images, while neglecting the highly corrupted visual perception of the fused results by modal differences and SAR speckle noise. To address this problem, in this paper we propose a novel optical and SAR image fusion framework named Visual Saliency Features Fusion (VSFF). We improved the decomposition algorithm of complementary feature to reduce most of the speckle noise in the initial features, and divide the image into main structure features and detail texture features. For the fusion of main structure features, we reconstruct a visual saliency features map that contains significant information from optical and SAR images, and input it together with the optical image into a total variation constraint model to compute the fusion result and achieve the optimal information transfer. Meanwhile, we construct a new feature descriptor based on Gabor wavelet, which separates meaningful detail texture features from residual noise and selectively preserves features that can improve the interpretability of fusion result. Further a fast IHS transform fusion is used to supplement the fused image with realistic color information. In a comparative analysis with five state-of-the-art fusion algorithms, VSFF achieved better results in qualitative and quantitative evaluations, and our fused images have a clear and appropriate visual perception.

Fusion Similarity-Based Reranking for SAR Image Retrieval.

SAR Image Content Retrieval Based on Fuzzy Similarity and Relevance Feedback

A TLRTV Dual-band SAR Image Denoise-Fusion Strategy and Its Preliminary Experiment Analysis in Multi-band Airborne Radar System

Feature Selection and Re-Weighting in Content-Based SAR Image Retrieval

Two-Stage Reranking for Remote Sensing Image Retrieval.

Learning to rerank images with enhanced spatial verification

A modified method for relevance feedback in high-resolution SAR image retrieval system based on SVM

Normalized Similarity Measurement And Query Adaptive Fusion For Graph Based Visual Reranking

Query-Adaptive Remote Sensing Image Retrieval Based on Image Rank Similarity and Image-to-Query Class Similarity.

Research on Image Fusion of SAR and Optical Image Based on Complementary Information Characteristics

Spatial Consistency Based Selective Reranking for Content Based Object Retrieval.

SAR and Infrared Image Fusion Based on Latent Low-rank Representation

Multiple Level Visual Semantic Fusion Method for Image Re-Ranking.

SAR Images Retrieval Based on Semantic Classification and Region-Based Similarity Measure for Earth Observation

A New Re-Ranking Method Using Enhanced Pseudo-Relevance Feedback for Content-Based Medical Image Retrieval

Query Adaptive Fusion for Graph-Based Visual Reranking.

OPTICAL AND SAR IMAGE FUSION BASED ON VISUAL SALIENCY FEATURES

Improving Object Retrieval Quality by Integration of Similarity Propagation and Query Expansion

Integrating Visual Saliency and Consistency for Re-Ranking Image Search Results

Multimodal Fusion for Video Search Reranking

Fusion of Multifeature Low-Rank Representation for Synthetic Aperture Radar Target Configuration Recognition.