Abstract:Human attention is an interactive activity between our visual system and our brain, using both low-level visual stimulus and high-level semantic information. Previous image salient object detection (SOD) studies conduct their saliency predictions via a multitask methodology in which pixelwise saliency regression and segmentation-like saliency refinement are conducted simultaneously. However, this multitask methodology has one critical limitation: the semantic information embedded in feature backbones might be degenerated during the training process. Our visual attention is determined mainly by semantic information, which is evidenced by our tendency to pay more attention to semantically salient regions even if these regions are not the most perceptually salient at first glance. This fact clearly contradicts the widely used multitask methodology mentioned above. To address this issue, this paper divides the SOD problem into two sequential steps. First, we devise a lightweight, weakly supervised deep network to coarsely locate the semantically salient regions. Next, as a postprocessing refinement, we selectively fuse multiple off-the-shelf deep models on the semantically salient regions identified by the previous step to formulate a pixelwise saliency map. Compared with the state-of-the-art (SOTA) models that focus on learning the pixelwise saliency in single images using only perceptual clues, our method aims at investigating the object-level semantic ranks between multiple images, of which the methodology is more consistent with the human attention mechanism. Our method is simple yet effective, and it is the first attempt to consider salient object detection as mainly an object-level semantic reranking problem.

Salient Object Detection Via Multi-Grained Refinement Polygon Topology Positive Feedback

Salient Object Detection Based on Visual Perceptual Saturation and Two-Stream Hybrid Networks.

Feature Perception and Refinement Network for Salient Object Detection

Dual-path Processing Network for High-resolution Salient Object Detection

DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection

Multi-Scale Feature Enhancement for Saliency Object Detection Algorithm

Saliency Detection Inspired by Topological Perception Theory

Adaptive Multi-Level Region Merging for Salient Object Detection.

Feature Refinement from Multiple Perspectives for High Performance Salient Object Detection.

A Multistage Refinement Network for Salient Object Detection

MSGC: A New Bottom-Up Model for Salient Object Detection

A Multi-Source Feature Extraction Network for Salient Object Detection

Hierarchical and Interactive Refinement Network for Edge-Preserving Salient Object Detection

Cross-modal and multi-level feature refinement network for RGB-D salient object detection

Multi-Color Space Network for Salient Object Detection

Rethinking Image Salient Object Detection: Object-Level Semantic Saliency Reranking First, Pixelwise Saliency Refinement Later

Bi-directional Progressive Guidance Network for RGB-D Salient Object Detection

Co-salient Object Detection with Iterative Purification and Predictive Optimization

Multi-modality information refinement fusion network for RGB-D salient object detection

Graph Model-Based Salient Object Detection Using Objectness and Multiple Saliency Cues.

CEMINet: Context exploration and multi-level interaction network for salient object detection