Abstract:The use of RGB-D information for salient object detection (SOD) has been extensively explored in recent years. However, relatively few efforts have been put toward modeling SOD in real-world human activity scenes with RGB-D. In this article, we fill the gap by making the following contributions to RGB-D SOD: 1) we carefully collect a new Salient Person (SIP) data set that consists of ~1 K high-resolution images that cover diverse real-world scenes from various viewpoints, poses, occlusions, illuminations, and background s; 2) we conduct a large-scale (and, so far, the most comprehensive) benchmark comparing contemporary methods, which has long been missing in the field and can serve as a baseline for future research, and we systematically summarize 32 popular models and evaluate 18 parts of 32 models on seven data sets containing a total of about 97k images; and 3) we propose a simple general architecture, called deep depth-depurator network (D3Net). It consists of a depth depurator unit (DDU) and a three-stream feature learning module (FLM), which performs low-quality depth map filtering and cross-modal feature learning, respectively. These components form a nested structure and are elaborately designed to be learned jointly. D3Net exceeds the performance of any prior contenders across all five metrics under consideration, thus serving as a strong model to advance research in this field. We also demonstrate that D3Net can be used to efficiently extract salient object masks from real scenes, enabling effective background-changing application with a speed of 65 frames/s on a single GPU. All the saliency maps, our new SIP data set, the D3Net model, and the evaluation tools are publicly available at https://github.com/DengPingFan/D3NetBenchmark.

RGB-D Image Saliency Detection from 3D Perspective

RGB-'D' Saliency Detection with Pseudo Depth.

RGB-D saliency detection based on multiple perspectives fusion

RGB-D Saliency Detection Based on Integration Feature of Color and Depth Saliency Map

RGB-D Image Saliency Detection via Background and Foreground Fusion

RGB-D Saliency detection Based on Saliency Center Prior and Saliency-depth Probability Adjustment

Triple-Complementary Network for RGB-D Salient Object Detection

Specificity-preserving RGB-D Saliency Detection

RGB-D Saliency Detection Via Complementary and Selective Learning

RGB-D Saliency Detection Based on Optimized ELM and Depth Level

Deep RGB-D Saliency Detection Without Depth

Selective features for RGB-D saliency

Saliency detection for RGBD image using optimization

RGB-D Saliency Detection via Depth Quality Perception and Hierarchical Feature Guidance

Salient Object Detection for RGBD Video Via Spatial Interaction and Depth-Based Boundary Refinement

Exploiting Global Priors for RGB-D Saliency Detection

RGB-D Saliency Detection Via Mutual Guided Manifold Ranking.

Depth Enhanced Saliency Detection Method

Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks

Rgbd Salient Object Detection: A Benchmark And Algorithms