Abstract:Recent years have witnessed growing interests in RGB-D Salient Object Detection (SOD), benefiting from the ample spatial layout cues embedded in depth maps to help SOD models distinguish salient objects from complex backgrounds or similar surroundings. Despite these progresses, this emerging line of research has been considerably hindered by the noise and ambiguity that prevail in raw depth images, as well as the coarse object boundaries in saliency predictions. To address the aforementioned issues, we propose a D epth C alibration and B oundary-aware F usion ( DCBF ) framework that contains two novel components: (1) a learning strategy to calibrate the latent bias in the original depth maps towards boosting the SOD performance; (2) a boundary-aware multimodal fusion module to fuse the complementary cues from RGB and depth channels, as well as to improve object boundary qualities. In addition, we introduce a new saliency dataset, HiBo-UA, which contains 1515 high-resolution RGB-D images with finely-annotated pixel-level labels. To our best knowledge, this is the first RGB-D-based high-resolution saliency dataset with significantly higher image resolution (nearly 7 ) than the widely used DUT-D dataset. The proposed high-resolution dataset with richer object boundary details is capable of accurately assessing the performance of various saliency models, in order to retain fine-grained object boundaries. It also facilitates the growing need of our research community in accessing higher-resolution data. Extensive empirical experiments demonstrate the superior performance of our approach against 31 state-of-the-art methods. It is worth noting that our calibrated depth alone can work in a plug-and-play manner; empirically it is shown to bring noticeable improvements when applied to existing state-of-the-art RGB-D SOD models.

Depth-Aware Layered Edge for Object Proposal

Elastic Edge Boxes for Object Proposal on RGB-D Images.

Object Proposal on RGB-D Images Via Elastic Edge Boxes

Object Proposal via Depth Connectivity Constrained Grouping.

Locating 3D Object Proposals: A Depth-Based Online Approach

Depth Cue Enhancement and Guidance Network for RGB-D Salient Object Detection

Depth incorporating with color improves salient object detection

Edge Boxes: Locating Object Proposals from Edges

A Novel Edge-Inspired Depth Quality Evaluation Network for RGB-D Salient Object Detection

Joint Boundary-Aware Method and Bayesian Inference for Object Proposal

Coordinate Attention Filtering Depth-Feature Guide Cross-Modal Fusion RGB-Depth Salient Object Detection

A New Edge Patch with Rotation Invariance for Object Detection and Pose Estimation.

Reinforcing Lidar-Based 3d Object Detection With Rgb And 3d Information

Directional Edge Boxes: Exploiting Inner Normal Direction Cues for Effective Object Proposal Generation

Adaptive Integration Of Depth And Color For Objectness Estimation

Context-Aware Video Object Proposals.

Synthetic Depth Transfer for Monocular 3D Object Pose Estimation in the Wild.

Delving into Calibrated Depth for Accurate RGB-D Salient Object Detection

ER-Pose: Learning Edge Representation for 6D Pose Estimation of Texture-Less Objects.

Salient Object Detection for RGBD Video Via Spatial Interaction and Depth-Based Boundary Refinement

Blind Proposal Quality Assessment Via Deep Objectness Representation And Local Linear Regression