Abstract:With the expansion of optical (OPT) and synthetic aperture radar (SAR) image fusion application scenarios, it is necessary to integrate their information into land classification, feature recognition, and target tracking. Current methods focus excessively on integrating multimodal feature information to enhance the information richness of the fused images, whereas neglecting the highly corrupted visual perception of the fused results by modal differences and SAR speckle noise. To address that, this article proposes a novel optical and SAR image fusion framework named visual saliency features fusion (VSFF), which is based on the extraction and balancing of significant complementary features of optical and SAR images. First, we propose a decomposition algorithm of complementary features to divide the image into main structure features (MSF) and detail texture features (DTF). Then, for the fusion of MSF, we reconstruct the visual saliency features (VSF) maps of the pixel and structure that contain significant information from optical and SAR images, and input them into a total variation constraint model to compute the fusion result and achieve the optimal information transfer. Meanwhile, we construct a new feature descriptor based on the Gabor wavelet that separates meaningful DTF from residual noise and selectively preserves features that can improve the interpretability of the fusion result. In a comparative analysis with seven state-of-the-art fusion algorithms, VSFF achieved better results in qualitative and quantitative evaluations, and our fused images have a clear and appropriate visual perception. The source code is publicly available at: https://github.com/yeyuanxin110/VSFF.

Compressed sensing based feature fusion for image retrieval

Fusion of Multiple VLAD Vectors Based on Different Features for Image Retrieval

A novel multi-feature fusion and sparse coding-based framework for image retrieval

Composite Descriptors and Deep Features Based Visual Phrase for Image Retrieval

An Effective Feature Fusion Solution for Image Retrieval.

Efficient Image Retrieval via Feature Fusion and Adaptive Weighting.

Adaptive multi-feature fusion via cross-entropy normalization for effective image retrieval

Boosting VLAD with Weighted Fusion of Local Descriptors for Image Retrieval.

OPTICAL AND SAR IMAGE FUSION BASED ON VISUAL SALIENCY FEATURES

Optical and SAR Image Fusion Based on Complementary Feature Decomposition and Visual Saliency Features

Subspace-based Multi-View Fusion for Instance-Level Image Retrieval

Feature Fusion for Image Retrieval with Adaptive Bitrate Allocation and Hard Negative Mining.

Exploiting global and local features for image retrieval

Image fusion in compressed sensing

A Novel Image Fusion Approach Based on Compressive Sensing

Spectral Embedding-Based Multiview Features Fusion for Content-Based Image Retrieval

A Hyperspectral Image Fusion Algorithm Based on Compressive Sensing

Image retrieval based on efficient index of multi-features

Augmented Feature Fusion for Image Retrieval System

Multi-Feature Fusion Image Retrieval Algorithm Based on Fuzzy Color

An Adaptive Weight Method for Image Retrieval Based Multi-Feature Fusion.