Abstract:The effectiveness of depth information in saliency detection has been fully proved. However, it is still worth exploring how to utilize the depth information more efficiently. Erroneous depth information may cause detection failure, while non-salient objects may be closer to the camera which also leads to erroneously emphasis on non-salient regions. Moreover, most of the existing RGB-D saliency detection models have poor robustness when the salient object touches the image boundaries. To mitigate these problems, we propose a multi-stage saliency detection model with the bilateral absorbing Markov chain guided by depth information. The proposed model progressively extracts the saliency cues with three level (low-, mid-, and high-level) stages. First, we generate low-level saliency cues by explicitly combining color and depth information. Then, we design a bilateral absorbing Markov chain to calculate mid-level saliency maps. In mid-level, to suppress boundary touch problem, we present the background seed screening mechanism (BSSM) for improving the construction of the two-layer sparse graph and better selecting background-based absorbing nodes. Furthermore, the cross-modal multi-graph learning model (CMLM) is designed to fully explore the intrinsic complementary relationship between color and depth information. Finally, to obtain a more highlighted and homogeneous saliency map in high-level, we structure a depth-guided optimization module which combines cellular automata and suppression-enhancement function pair. This optimization module refines the saliency map in color space and depth space, respectively. Comprehensive experiments on three challenging benchmark datasets demonstrate the effectiveness of our proposed method both qualitatively and quantitatively.

Saliency Map Estimation Using a Pixel-Pairwise-Based Unsupervised Markov Random Field Model

Saliency Detection Via Local Single Gaussian Model

Salient Region Detection Algorithm Via KL Divergence and Multi-scale Merging

Mesh Saliency Detection Via Double Absorbing Markov Chain in Feature Space

End-to-End Saliency Mapping via Probability Distribution Prediction

Efficient Saliency Detection Based on Gaussian Models

Visual Saliency with Statistical Priors

Nonparametric saliency detection using kernel density estimation

Image Saliency Estimation Via Random Walk Guided by Informativeness and Latent Signal Correlations

Uncertainty Inspired RGB-D Saliency Detection

Manifold Ranking-Based Matrix Factorization for Saliency Detection

Image segmentation by MAP-ML estimations.

A multi-stage area saliency detection model

Estimating Visual Saliency Through Single Image Optimization

Energy-Based Generative Cooperative Saliency Prediction

Saliency Detection Based on Integration of Central Bias, Reweighting and Multi-Scale for Superpixels

Probabilistic Multi-Task Learning for Visual Saliency Estimation in Video

Saliency Detection with Bilateral Absorbing Markov Chain Guided by Depth Information

An Energy-Based Prior for Generative Saliency

A Biological Inspired Features Based Saliency Map

Saliency Fusion in Eigenvector Space with Multi-Channel Pulse Coupled Neural Network