Abstract:The effectiveness of depth information in saliency detection has been fully proved. However, it is still worth exploring how to utilize the depth information more efficiently. Erroneous depth information may cause detection failure, while non-salient objects may be closer to the camera which also leads to erroneously emphasis on non-salient regions. Moreover, most of the existing RGB-D saliency detection models have poor robustness when the salient object touches the image boundaries. To mitigate these problems, we propose a multi-stage saliency detection model with the bilateral absorbing Markov chain guided by depth information. The proposed model progressively extracts the saliency cues with three level (low-, mid-, and high-level) stages. First, we generate low-level saliency cues by explicitly combining color and depth information. Then, we design a bilateral absorbing Markov chain to calculate mid-level saliency maps. In mid-level, to suppress boundary touch problem, we present the background seed screening mechanism (BSSM) for improving the construction of the two-layer sparse graph and better selecting background-based absorbing nodes. Furthermore, the cross-modal multi-graph learning model (CMLM) is designed to fully explore the intrinsic complementary relationship between color and depth information. Finally, to obtain a more highlighted and homogeneous saliency map in high-level, we structure a depth-guided optimization module which combines cellular automata and suppression-enhancement function pair. This optimization module refines the saliency map in color space and depth space, respectively. Comprehensive experiments on three challenging benchmark datasets demonstrate the effectiveness of our proposed method both qualitatively and quantitatively.

Image Retargeting Using Depth Enhanced Saliency

Optimal Bi-Directional Seam Carving for Compressibility-Aware Image Retargeting

Adaptive Image Retargeting Using Saliency-Based Continuous Seam Carving

Detect saliency to understand a photo

Image Re-Targeting with Balanced Energy Map and Foreground Constraint

Guided depth enhancement via a fast marching method

Deep learning-based importance map for content-aware media retargeting

Depth map enhancement based on color and depth consistency

Depth incorporating with color improves salient object detection

Depth-Aided Inpainting for Disocclusion Restoration of Multi-View Images Using Depth-Image-Based Rendering

Lowcomplexity Content-Aware Image Retargeting

Saliency Detection with Bilateral Absorbing Markov Chain Guided by Depth Information

Seam Searching-Based Pixel Fusion for Image Retargeting.

Image Retargeting Assessment Based on Salient Region Similarity

Depth Cue Enhancement and Guidance Network for RGB-D Salient Object Detection

Analysis of seam carving technique: limitations, improvements and possible solutions

Image Retargeting by Combining Region Warping and Occlusion.

Fast Video Retargeting Based on Seam Carving with Parental Labeling

Region-based depth-preserving stereoscopic image retargeting

Depth Super-Resolution Using Joint Adaptive Weighted Least Squares and Patching Gradient.

An Improved Video Retargeting Technique Based on Discontinuous Seam Caving