Abstract:How to explore useful information from depth is the key success of the RGB-D saliency detection methods. While the RGB and depth images are from different domains, a modality gap will lead to unsatisfactory results for simple feature concatenation. Towards better performance, most methods focus on bridging this gap and designing different cross-modal fusion modules for features, while ignoring explicitly extracting some useful consistent information from them. To overcome this problem, we develop a simple yet effective RGB-D saliency detection method by learning discriminative cross-modality features based on the deep neural network. The proposed method first learns modality-specific features for RGB and depth inputs. And then we separately calculate the correlations of every pixel-pair in a cross-modality consistent way, i.e., the distribution ranges are consistent for the correlations calculated based on features extracted from RGB (RGB correlation) or depth inputs (depth correlation). From different perspectives, color or spatial, the RGB and depth correlations end up at the same point to depict how tightly each pixel-pair is related. Secondly, to complemently gather RGB and depth information, we propose a novel correlation-fusion to fuse RGB and depth correlations, resulting in a cross-modality correlation. Finally, the features are refined with both long-range cross-modality correlations and local depth correlations to predict salient maps. In which, the long-range cross-modality correlation provides context information for accurate localization, and the local depth correlation keeps good subtle structures for fine segmentation. In addition, a lightweight DepthNet is designed for efficient depth feature extraction. We solve the proposed network in an end-to-end manner. Both quantitative and qualitative experimental results demonstrate the proposed algorithm achieves favorable performance against state-of-the-art methods.

Selective features for RGB-D saliency

RGB-D Saliency Detection Via Complementary and Selective Learning

Select, Supplement And Focus For Rgb-D Saliency Detection

Specificity-preserving RGB-D Saliency Detection

RGB-D Saliency Detection Based on Integration Feature of Color and Depth Saliency Map

Learning Discriminative Cross-Modality Features for RGB-D Saliency Detection

RGB-D Saliency Detection Based on Optimized ELM and Depth Level

Dynamic Selective Network for RGB-D Salient Object Detection

Deep RGB-D Saliency Detection Without Depth

Depth Guided Feature Selection for RGBD Salient Object Detection

Synergistic Saliency and Depth Prediction for RGB-D Saliency Detection

Cross-modal Feature Extraction and Integration Based RGBD Saliency Detection

RGB-'D' Saliency Detection with Pseudo Depth.

Depth-guided Saliency Detection Via Boundary Information

Depth incorporating with color improves salient object detection

Multi-level progressive parallel attention guided salient object detection for RGB-D images

RGB-D Image Saliency Detection from 3D Perspective

Attention-guided RGBD Saliency Detection Using Appearance Information

RGB-D Saliency Detection Via Mutual Guided Manifold Ranking.

Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusion

Depth Enhanced Saliency Detection Method