Abstract:Deep learning methods, with their good performance in semantic representation of different images, have been widely used for saliency detection. Recent saliency detection methods have applied deep learning to obtain high-level features and combined them with hand-crafted low-level features to estimate saliency in the images. However, it is difficult to find the relationship between high-level and low-level features, resulting in incomplete integration framework for saliency detection. In this paper, we novely propose a saliency detection model by integrating high-level and low-level features with joint probability estimation. Firstly, the high-level features from FCN-8S network are used to estimate the probability of each superpixel as foreground or background region. Secondly, low-level features are extracted from each superpixels and clustered via affinity propagation (AP) clustering. The distributions of vectors from different clusters are consequently utilized to calculate the conditional probability of each superpixel as salient object under different assumptions. Thirdly, the joint probability of each superpixel as salient object in foreground or background is computed to compose the saliency map of the whole image. To further improve the uniformity of saliency in the same object region, the structured random forest (SRF) method is used to detect the contour of the image and the saliency of superpixels in homogeneous regions are uniformly merged. The advantage of high-level features in representing semantic regions and that of low-level features in differentiating local details in the image are unified and restrained by the joint probability estimation in the proposed model. Experimental results demonstrate that the proposed method provide better saliency detection performance than the state-of-the-art methods on 5 public databases.

Saliency Detection Via Cross-Scale Deep Inference

Deep Reasoning with Multi-Scale Context for Salient Object Detection

Saliency Detection Within a Deep Convolutional Architecture

Enriched Feature Representation and Combination for Deep Saliency Detection

Visual Saliency Detection Based on Multiscale Deep CNN Features

Saliency Detection Via Integrating Deep Learning Architecture and Low-Level Features

Attention To The Scale : Deep Multi-Scale Salient Object Detection

CSA-Net: Deep Cross-Complementary Self Attention and Modality-Specific Preservation for Saliency Detection

DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection

Saliency Prediction Based on New Deep Multi-Layer Convolution Neural Network

A Novel Deep Network and Aggregation Model for Saliency Detection

Saliency Region Detection in Complex Scenes Based on Multi-scale Cascaded Attention

Predicting Visual Saliency Via A Dilated Inception Module-Based Model

Visual Saliency Based on Scale-Space Analysis in the Frequency Domain

Video Saliency Detection Using Deep Convolutional Neural Networks.

Saliency Detection Based on Multiple-Level Feature Learning

Deep supervised visual saliency model addressing low-level features

A Multiscale Dilated Dense Convolutional Network for Saliency Prediction with Instance-Level Attention Competition

Saliency Detection Via Sparse Reconstruction and Joint Label Inference in Multiple Features

Salient Object Detection Via Multi-Scale Attention CNN

Saliency Detection via Multi-Scale Global Cues