Abstract:How to explore useful information from depth is the key success of the RGB-D saliency detection methods. While the RGB and depth images are from different domains, a modality gap will lead to unsatisfactory results for simple feature concatenation. Towards better performance, most methods focus on bridging this gap and designing different cross-modal fusion modules for features, while ignoring explicitly extracting some useful consistent information from them. To overcome this problem, we develop a simple yet effective RGB-D saliency detection method by learning discriminative cross-modality features based on the deep neural network. The proposed method first learns modality-specific features for RGB and depth inputs. And then we separately calculate the correlations of every pixel-pair in a cross-modality consistent way, i.e., the distribution ranges are consistent for the correlations calculated based on features extracted from RGB (RGB correlation) or depth inputs (depth correlation). From different perspectives, color or spatial, the RGB and depth correlations end up at the same point to depict how tightly each pixel-pair is related. Secondly, to complemently gather RGB and depth information, we propose a novel correlation-fusion to fuse RGB and depth correlations, resulting in a cross-modality correlation. Finally, the features are refined with both long-range cross-modality correlations and local depth correlations to predict salient maps. In which, the long-range cross-modality correlation provides context information for accurate localization, and the local depth correlation keeps good subtle structures for fine segmentation. In addition, a lightweight DepthNet is designed for efficient depth feature extraction. We solve the proposed network in an end-to-end manner. Both quantitative and qualitative experimental results demonstrate the proposed algorithm achieves favorable performance against state-of-the-art methods.

RGB-D Saliency Detection Via Complementary and Selective Learning

Specificity-preserving RGB-D Saliency Detection

Select, Supplement And Focus For Rgb-D Saliency Detection

Learning Discriminative Cross-Modality Features for RGB-D Saliency Detection

RGB-D Saliency Detection via Depth Quality Perception and Hierarchical Feature Guidance

Triple-Complementary Network for RGB-D Salient Object Detection

RGB-D Saliency Detection Based on Integration Feature of Color and Depth Saliency Map

Adaptive Fusion for RGB-D Salient Object Detection.

Towards accurate RGB-D saliency detection with complementary attention and adaptive integration

Synergistic Saliency and Depth Prediction for RGB-D Saliency Detection

Dynamic Selective Network for RGB-D Salient Object Detection

EF-Net: A Novel Enhancement and Fusion Network for RGB-D Saliency Detection

Selective features for RGB-D saliency

RGB-D Image Saliency Detection Based on Multi-modal Feature-fused Supervision

Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusion

RGB-D Visual Saliency Detection Algorithm Based on Information Guided and Multimodal Feature Fusion

Learnable Depth-Sensitive Attention for Deep RGB-D Saliency Detection with Multi-modal Fusion Architecture Search

Coordinate Attention Filtering Depth-Feature Guide Cross-Modal Fusion RGB-Depth Salient Object Detection

Learning Selective Mutual Attention and Contrast for RGB-D Saliency Detection

RGB-D Salient Object Detection Method Based on Multi-Modal Fusion and Contour Guidance

Deep RGB-D Saliency Detection Without Depth