Abstract:Human attention is an interactive activity between our visual system and our brain, using both low-level visual stimulus and high-level semantic information. Previous image salient object detection (SOD) studies conduct their saliency predictions via a multitask methodology in which pixelwise saliency regression and segmentation-like saliency refinement are conducted simultaneously. However, this multitask methodology has one critical limitation: the semantic information embedded in feature backbones might be degenerated during the training process. Our visual attention is determined mainly by semantic information, which is evidenced by our tendency to pay more attention to semantically salient regions even if these regions are not the most perceptually salient at first glance. This fact clearly contradicts the widely used multitask methodology mentioned above. To address this issue, this paper divides the SOD problem into two sequential steps. First, we devise a lightweight, weakly supervised deep network to coarsely locate the semantically salient regions. Next, as a postprocessing refinement, we selectively fuse multiple off-the-shelf deep models on the semantically salient regions identified by the previous step to formulate a pixelwise saliency map. Compared with the state-of-the-art (SOTA) models that focus on learning the pixelwise saliency in single images using only perceptual clues, our method aims at investigating the object-level semantic ranks between multiple images, of which the methodology is more consistent with the human attention mechanism. Our method is simple yet effective, and it is the first attempt to consider salient object detection as mainly an object-level semantic reranking problem.

Selective Rendering with Graphical Saliency Model

Saliency Detection Via Local Single Gaussian Model

Joint visual attention and rendering complexity based sample rate estimation in selective rendering

Adaptive Image Retargeting Using Saliency-Based Continuous Seam Carving

Efficient Saliency Detection Based on Gaussian Models

Saliency Computation Via Whitened Frequency Band Selection

A Survey of Visual Attention and Saliency Computation

Saliency Preservation in Low-Resolution Grayscale Images

GreenSaliency: A Lightweight and Efficient Image Saliency Detection Method

Saliency Guided Optimization of Diffusion Latents

High Speed Visual Saliency Computation on GPU.

Active Visual Computing Model Based on Data- and Knowledge-Driven Selective Attention Mechanism.

Influence of Spatial Resolution on State-of-the-Art Saliency Models.

A Saliency Detection Model Using Aggregation Degree of Color and Texture

Review of Visual Saliency Detection with Comprehensive Information

Rethinking Image Salient Object Detection: Object-Level Semantic Saliency Reranking First, Pixelwise Saliency Refinement Later

Efficient Saliency-Model-Guided Visual Co-Saliency Detection

Research on Visual Saliency Model Based on CovSal Algorithm and Histogram Contrast

Saliency Detection by Selective Strategy for Salient Object Segmentation.

A New Saliency Detection Model in Remote Sensing Images with Sea Background

A new visual saliency model based on Tobii eye tracking and multiscale conditional random fields