Abstract:Recent years have witnessed growing interests in RGB-D Salient Object Detection (SOD), benefiting from the ample spatial layout cues embedded in depth maps to help SOD models distinguish salient objects from complex backgrounds or similar surroundings. Despite these progresses, this emerging line of research has been considerably hindered by the noise and ambiguity that prevail in raw depth images, as well as the coarse object boundaries in saliency predictions. To address the aforementioned issues, we propose a D epth C alibration and B oundary-aware F usion ( DCBF ) framework that contains two novel components: (1) a learning strategy to calibrate the latent bias in the original depth maps towards boosting the SOD performance; (2) a boundary-aware multimodal fusion module to fuse the complementary cues from RGB and depth channels, as well as to improve object boundary qualities. In addition, we introduce a new saliency dataset, HiBo-UA, which contains 1515 high-resolution RGB-D images with finely-annotated pixel-level labels. To our best knowledge, this is the first RGB-D-based high-resolution saliency dataset with significantly higher image resolution (nearly 7 ) than the widely used DUT-D dataset. The proposed high-resolution dataset with richer object boundary details is capable of accurately assessing the performance of various saliency models, in order to retain fine-grained object boundaries. It also facilitates the growing need of our research community in accessing higher-resolution data. Extensive empirical experiments demonstrate the superior performance of our approach against 31 state-of-the-art methods. It is worth noting that our calibrated depth alone can work in a plug-and-play manner; empirically it is shown to bring noticeable improvements when applied to existing state-of-the-art RGB-D SOD models.

Saliency Cuts on RGB-D Images.

Adaptive saliency cuts

Saliency Cuts Based on Adaptive Triple Thresholding.

Saliency Cuts: Salient Region Extraction based on Local Adaptive Thresholding for Image Information Recognition of the Visually Impaired

Salient object detection in RGB-D image based on saliency fusion and propagation

Saliency Detection by Selective Strategy for Salient Object Segmentation.

Salient Object Detection for RGB-D Image Via Saliency Evolution

Delving into Calibrated Depth for Accurate RGB-D Salient Object Detection

Saliency Detection with Bilateral Absorbing Markov Chain Guided by Depth Information

Unsupervised Salient Object Segmentation Based on Kernel Density Estimation and Two-Phase Graph Cut

Salient Object Detection and Segmentation

Dynamic Selective Network for RGB-D Salient Object Detection

An Iterative Co-Saliency Framework for RGBD Images

An Innovative Salient Object Detection Using Center-Dark Channel Prior

Exploiting Global Priors for RGB-D Saliency Detection

Salient Object Extraction Based on Region Saliency Ratio

Depth-aware salient object detection using anisotropic center-surround difference

CNNs-Based RGB-D Saliency Detection Via Cross-View Transfer and Multiview Fusion.

Coordinate Attention Filtering Depth-Feature Guide Cross-Modal Fusion RGB-Depth Salient Object Detection

Adaptive Fusion for RGB-D Salient Object Detection.

Depth-Aware Salient Object Detection and Segmentation Via Multiscale Discriminative Saliency Fusion and Bootstrap Learning