Abstract:The effectiveness of depth information in saliency detection has been fully proved. However, it is still worth exploring how to utilize the depth information more efficiently. Erroneous depth information may cause detection failure, while non-salient objects may be closer to the camera which also leads to erroneously emphasis on non-salient regions. Moreover, most of the existing RGB-D saliency detection models have poor robustness when the salient object touches the image boundaries. To mitigate these problems, we propose a multi-stage saliency detection model with the bilateral absorbing Markov chain guided by depth information. The proposed model progressively extracts the saliency cues with three level (low-, mid-, and high-level) stages. First, we generate low-level saliency cues by explicitly combining color and depth information. Then, we design a bilateral absorbing Markov chain to calculate mid-level saliency maps. In mid-level, to suppress boundary touch problem, we present the background seed screening mechanism (BSSM) for improving the construction of the two-layer sparse graph and better selecting background-based absorbing nodes. Furthermore, the cross-modal multi-graph learning model (CMLM) is designed to fully explore the intrinsic complementary relationship between color and depth information. Finally, to obtain a more highlighted and homogeneous saliency map in high-level, we structure a depth-guided optimization module which combines cellular automata and suppression-enhancement function pair. This optimization module refines the saliency map in color space and depth space, respectively. Comprehensive experiments on three challenging benchmark datasets demonstrate the effectiveness of our proposed method both qualitatively and quantitatively.

Saliency detection based on manifold learning

Saliency Detection Via Local Single Gaussian Model

Learning Exemplar-Represented Manifolds in Latent Space for Classification.

Eigenobject-wise saliency detection based on manifold ranking.

Visual Saliency Detection Based on Topographic Independent Component Analysis

Super Diffusion for Salient Object Detection.

Varying Manifolds in Diffusion: From Time-varying Geometries to Visual Saliency

Saliency Detection Based on Multiple-Level Feature Learning

DeepSaliency : MultiTask Deep Neural Network Model for Salient Object Detection

Efficient Saliency Detection Based on Gaussian Models

A multi-stage area saliency detection model

Geodesic Based Semi-supervised Multi-manifold Feature Extraction

Co-Saliency Detection via a General Optimization Model and Adaptive Graph Learning

Visual Saliency via Multiscale Analysis in Frequency Domain and Its Applications to Ship Detection in Optical Satellite Images

Manifold Ranking-Based Matrix Factorization for Saliency Detection

What Do Deep Saliency Models Learn about Visual Attention?

Visual Saliency Detection Via Sparsity Pursuit

A Novel Method to Study Bottom-up Visual Saliency and its Neural Mechanism

Saliency Detection with Bilateral Absorbing Markov Chain Guided by Depth Information

Visual Saliency Detection Via Rank-Sparsity Decomposition

Saliency Detection Based on Scale Selectivity of Human Visual System