Abstract:Recent years have witnessed growing interests in RGB-D Salient Object Detection (SOD), benefiting from the ample spatial layout cues embedded in depth maps to help SOD models distinguish salient objects from complex backgrounds or similar surroundings. Despite these progresses, this emerging line of research has been considerably hindered by the noise and ambiguity that prevail in raw depth images, as well as the coarse object boundaries in saliency predictions. To address the aforementioned issues, we propose a D epth C alibration and B oundary-aware F usion ( DCBF ) framework that contains two novel components: (1) a learning strategy to calibrate the latent bias in the original depth maps towards boosting the SOD performance; (2) a boundary-aware multimodal fusion module to fuse the complementary cues from RGB and depth channels, as well as to improve object boundary qualities. In addition, we introduce a new saliency dataset, HiBo-UA, which contains 1515 high-resolution RGB-D images with finely-annotated pixel-level labels. To our best knowledge, this is the first RGB-D-based high-resolution saliency dataset with significantly higher image resolution (nearly 7 ) than the widely used DUT-D dataset. The proposed high-resolution dataset with richer object boundary details is capable of accurately assessing the performance of various saliency models, in order to retain fine-grained object boundaries. It also facilitates the growing need of our research community in accessing higher-resolution data. Extensive empirical experiments demonstrate the superior performance of our approach against 31 state-of-the-art methods. It is worth noting that our calibrated depth alone can work in a plug-and-play manner; empirically it is shown to bring noticeable improvements when applied to existing state-of-the-art RGB-D SOD models.

Depth-inspired Label Mining for Unsupervised RGB-D Salient Object Detection

Unsupervised Salient Object Detection Based on Depth-Induced Pseudo-Labels Updating

Boosting RGB-D Saliency Detection by Leveraging Unlabeled RGB Images

Depth Cue Enhancement and Guidance Network for RGB-D Salient Object Detection

Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusion

Decoupled Pseudo-labeling for Semi-Supervised Monocular 3D Object Detection

Calibrated RGB-D Salient Object Detection

RGB-Guided Depth Feature Enhancement for RGB–Depth Salient Object Detection

Lightweight Multi-modal Representation Learning for RGB Salient Object Detection

Is Depth Really Necessary for Salient Object Detection?

Deep Hypersphere Feature Regularization for Weakly Supervised RGB-D Salient Object Detection.

Unsupervised Domain Adaptive Salient Object Detection Through Uncertainty-Aware Pseudo-Label Learning

Depth-Induced Gap-Reducing Network for RGB-D Salient Object Detection: an Interaction, Guidance and Refinement Approach

RGB-D Salient Object Detection with Ubiquitous Target Awareness

Learnable Depth-Sensitive Attention for Deep RGB-D Saliency Detection with Multi-modal Fusion Architecture Search

Depth Quality-Aware Selective Saliency Fusion for RGB-D Image Salient Object Detection

Joint Semantic Mining for Weakly Supervised RGB-D Salient Object Detection.

Delving into Calibrated Depth for Accurate RGB-D Salient Object Detection

Knowing Depth Quality in Advance: A Depth Quality Assessment Method for RGB-D Salient Object Detection

Multi-Source Uncertainty Mining for Deep Unsupervised Saliency Detection

Advancing in RGB-D Salient Object Detection: A Survey