Abstract:Unsupervised salient object detection is an important task in many real-world scenarios where pixel-wise label information is of scarce availability. Despite its significance, this problem remains rarely explored, with a few works that consider unsupervised salient object detection methods based on the fused graph from the sum fusion of multiple deep feature similarity matrices. However, these methods ignore the interrelation of the low-level feature similarity matrices and the high-level semantic similarity matrice, which degrades the quality of the fused graph. In this paper, we propose a semantic-consistency-guided multi-graph fusion learning algorithm for unsupervised saliency detection, where the consistency and inconsistency between multiple low-level feature similarity matrices and the high-level semantic similarity matrice are explored to promote the robustness and quality of the fused graph. In the first stage, a semantic-consistency-guided multi-graph fusion learning method is proposed to exploit consistency and inconsistency of multiple low-level deep features and the high-level semantic feature. The semantic-consistency-guided similarity matrices are computed for preliminary saliency ranking. In the following saliency refinement stage, the semantic-enhanced similarity matrices are built by the cross diffusion to fuse the multiple low-level deep features and the high semantic deep feature. Based on the semantic-enhanced similarity matrices, the refinement saliency maps are calculated in a semantic-enhanced cellular automata manner. Furthermore, the final ensemble stage of the large margin semi-supervised classification views the preliminary ranking results and refinement results as features, adopts the large margin graphs for saliency ensemble. Extensive evaluations over four benchmark datasets show that the proposed unsupervised method performs favorably against the state of-the-art approaches and is competitive with some supervised deep learning-based methods.

Text-Image Retrieval With Salient Features

Efficient Classification Using Salient Regions

Learning Feature Embedding with Strong Neural Activations for Fine-Grained Retrieval

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

Retrieval Oriented Deep Feature Learning With Complementary Supervision Mining.

Salient Object Detection via Bilateral Feature Fusion and Score Sorting Attention Mechanism

Feature Fusion Based on Transformer for Cross-modal Retrieval

Exploiting sublimated deep features for image retrieval

FB-Net: Dual-Branch Foreground-Background Fusion Network With Multi-Scale Semantic Scanning for Image-Text Retrieval

Scene Graph Based Fusion Network For Image-Text Retrieval

Revisiting Feature Fusion for RGB-T Salient Object Detection

Visual and textual fusion for semantically supervised region-based retrieval

Semantic-Consistency-guided Learning on Deep Features for Unsupervised Salient Object Detection

SCFusion: Infrared and Visible Fusion Based on Salient Compensation

Image Matching and Localization Based on Fusion of Handcrafted and Deep Features

Image-Text Retrieval with Cross-Modal Semantic Importance Consistency.

Object retrieval using configurations of salient regions

Salient Object Detection Via Region Shape Feature Contrast and Saliency Fusion.

Detected text-based image retrieval approach for textual images

Saliency Optimization Fused Background Feature with Frequency Domain Features

Salient Object Detection: A Discriminative Regional Feature Integration Approach