Abstract:Salient object detection is a fundamental problem in image processing and computer vision. Many saliency detection algorithms based on the background and frequency-domain are used to extract salient object clues. However, the former causes the real object to be submerged in the detected object areas, especially in complex or small object scenes. While the latter will lead to the loss of some object information when detecting large objects. To solve these problems and achieve better object detection results, we propose a fusion framework for salient object detection by fusing background and frequency-domain features. The background features of the image are extracted by an improved background model. This model represents the spatial layout of the image area with respect to the image boundaries. Meanwhile, we present a new frequency-domain processing method to obtain multiscale frequency-domain features and mark the saliency of the object at different scales. Within our framework, inspired by human visual attention, we use the idea of a self-attention mechanism to capture the intrinsic relation between background and multiscale frequency-domain features. In addition, this fusion framework provides a three-dimensional Gaussian convolution kernel, which expands two-dimensional local information to three dimensions for feature fusion, thus producing more accurate salient objects. Experiment results demonstrate that the proposed method consistently outperforms eleven state-of-the-art methods on five challenging and complicated datasets in terms of four evaluation metrics.

Visual Saliency Detection: from Space to Frequency.

Color boosted visual saliency detection and its application to image classification

Visual Saliency Based on Scale-Space Analysis in the Frequency Domain

Saliency Detection by Adaptive Channel Fusion

Spatio-Temporal Saliency Perception Via Hypercomplex Frequency Spectral Contrast

Finding the Secret of Image Saliency in the Frequency Domain

Joint Space–Frequency for Saliency Detection in Optical Remote Sensing Images

Saliency Detection: A Spectral Residual Approach.

Saliency detection using a central stimuli sensitivity based model

Salient Object Detection In Hyperspectral Imagery

Visual Saliency: a Biologically Plausible Contourlet-Like Frequency Domain Approach

Image Saliency Detection Algorithm Based on Spatial and Frequency Domain

Visual Saliency via Multiscale Analysis in Frequency Domain and Its Applications to Ship Detection in Optical Satellite Images

Detecting Image Saliency Based on Spectrum Analysis

An improved computational model for image saliency detection

Video Saliency Detection via Dynamic Consistent Spatio-Temporal Attention Modelling.

Saliency Detection Based on Scale Selectivity of Human Visual System

Visual saliency detection by integrating spatial position prior of object with background cues

Saliency Computation Via Whitened Frequency Band Selection

A Saliency Model Based on Wavelet Transform and Visual Attention

Salient Detection Via the Fusion of Background-Based and Multiscale Frequency-Domain Features