Abstract:RGB image and depth map (RGB-D)-based salient object detection (SOD) has been well-studied in recent years, especially using deep neural networks. An RGB image provides rich local and semantic features, while the depth map provides global structural information. Many researchers have treated depth information as a supplement to RGB maps. However, depth maps in various datasets are not as precise as RGB information, as they are captured under various conditions. Therefore, thoroughly exploiting these features at different levels remains unresolved. Many cognitive theories, such as the topological perception theory, claim that global properties are prior to local ones and are important for human recognition. In this paper, we propose a novel global-prior-guided fusion network with global-prior extraction modules to fuse cross-modality features. Each module contains a cross attention guided by deeper global priors, and the global prior extracted by this module is used to guide the processing of local features in shallow layers. The global guided network first integrates the local and global cross features into the decoder of depth maps, and then the fused structural features of the decoder are finally fused into the saliency decoder. Experimental results show that our method outperformed other state-of-the-art methods in the RGB-D-based SOD task on seven datasets (i.e., DUT-RGBD, NJUD, LFSD, NLPR, RGBD135, SIP, and STERE) and in terms of most metrics. To thoroughly exploit the modules we designed, we extended our model to accomplish the tasks of RGB and video SOD with slight adaptions, and obtained results comparable to those of the state-of-the-art (SOTA) methods in both fields.

Salient Object Detection Via a Local and Global Method Based on Deep Residual Network

Deep Salient Object Detection Via Hierarchical Network Learning

Deep Networks for Saliency Detection Via Local Estimation and Global Search

Integrated Deep and Shallow Networks for Salient Object Detection

DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection

Residual Dense Collaborative Network for Salient Object Detection

Non-local Deep Features for Salient Object Detection

Residual attentive feature learning network for salient object detection

Salient Object Detection Based on Visual Perceptual Saturation and Two-Stream Hybrid Networks.

Accurate salient object detection via dense recurrent connections and residual-based hierarchical feature integration.

Salient Object Detection Based on an Efficient End-to-End Saliency Regression Network

Deep Sub-Region Network for Salient Object Detection

Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network

Salient Object Detection in Low Contrast Images Via Global Convolution and Boundary Refinement.

Image Salient Object Detection with Refined Deep Features Via Convolution Neural Network

Disentangled High Quality Salient Object Detection

Deep Layer Guided Network for Salient Object Detection

LHRNet: Lateral Hierarchically Refining Network for Salient Object Detection

Salient Object Detection Based on Regions

Global-prior-guided fusion network for salient object detection