Abstract:To solve the saliency detection problem in RGB-D images, the depth information plays a critical role in distinguishing salient objects or foregrounds from cluttered backgrounds. As the complementary component to color information, the depth quality directly dictates the subsequent saliency detection performance. However, due to artifacts and the limitation of depth acquisition devices, the quality of the obtained depth varies tremendously across different scenarios. Consequently, conventional selective fusion-based RGB-D saliency detection methods may result in a degraded detection performance in cases containing salient objects with low color contrast coupled with a low depth quality. To solve this problem, we make our initial attempt to estimate additional high-quality depth information, which is denoted by Depth + . Serving as a complement to the original depth, Depth + will be fed into our newly designed selective fusion network to boost the detection performance. To achieve this aim, we first retrieve a small group of images that are similar to the given input, and then the inter-image, nonlocal correspondences are built accordingly. Thus, by using these inter-image correspondences, the overall depth can be coarsely estimated by utilizing our newly designed depth-transferring strategy. Next, we build fine-grained, object-level correspondences coupled with a saliency prior to further improve the depth quality of the previous estimation. Compared to the original depth, our newly estimated Depth + is potentially more informative for detection improvement. Finally, we feed both the original depth and the newly estimated Depth + into our selective deep fusion network, whose key novelty is to achieve an optimal complementary balance to make better decisions toward improving saliency boundaries.

Two-Stream Refinement Network for RGB-D Saliency Detection

Multi-scale iterative refinement network for RGB-D salient object detection

Cross-modal and multi-level feature refinement network for RGB-D salient object detection

Salient Object Detection for RGBD Video Via Spatial Interaction and Depth-Based Boundary Refinement

Triple-Complementary Network for RGB-D Salient Object Detection

Feature Perception and Refinement Network for Salient Object Detection

Real-Time One-Stream Semantic-Guided Refinement Network for RGB-Thermal Salient Object Detection

RGB-D Saliency Detection via Depth Quality Perception and Hierarchical Feature Guidance

M2RNet: Multi-modal and Multi-scale Refined Network for RGB-D Salient Object Detection

EF-Net: A Novel Enhancement and Fusion Network for RGB-D Saliency Detection

CIR-Net: Cross-Modality Interaction and Refinement for RGB-D Salient Object Detection

Multi-modality information refinement fusion network for RGB-D salient object detection

Salient Object Detection Based on Visual Perceptual Saturation and Two-Stream Hybrid Networks.

R2Net: Residual refinement network for salient object detection

Dynamic Selective Network for RGB-D Salient Object Detection

Data-Level Recombination and Lightweight Fusion Scheme for RGB-D Salient Object Detection

Transformer-based Network for RGB-D Saliency Detection

Co-Saliency Detection Via Local Prediction and Global Refinement.

Depth-aware Inverted Refinement Network for RGB-D Salient Object Detection

Cross-modal refined adjacent-guided network for RGB-D salient object detection

Improved Saliency Detection in RGB-D Images Using Two-Phase Depth Estimation and Selective Deep Fusion