Abstract:Deep convolutional neural networks have become a key element in the recent breakthrough of salient object detection. However, existing CNN-based methods are based on either patch-wise (region-wise) training and inference or fully convolutional networks. Methods in the former category are generally time-consuming due to severe storage and computational redundancies among overlapping patches. To overcome this deficiency, methods in the second category attempt to directly map a raw input image to a predicted dense saliency map in a single network forward pass. Though being very efficient, it is arduous for these methods to detect salient objects of different scales or salient regions with weak semantic information. In this paper, we develop hybrid contrast-oriented deep neural networks to overcome the aforementioned limitations. Each of our deep networks is composed of two complementary components, including a fully convolutional stream for dense prediction and a segment-level spatial pooling stream for sparse saliency inference. We further propose an attentional module that learns weight maps for fusing the two saliency predictions from these two streams. A tailored alternate scheme is designed to train these deep networks by fine-tuning pre-trained baseline models. Finally, a customized fully connected CRF model incorporating a salient contour feature embedding can be optionally applied as a post-processing step to improve spatial coherence and contour positioning in the fused result from these two streams. Extensive experiments on six benchmark datasets demonstrate that our proposed model can significantly outperform the state of the art in terms of all popular evaluation metrics.

Covariance Descriptor Based Convolution Neural Network for Saliency Computation in Low Contrast Images.

Efficient Saliency Detection Using Convolutional Neural Networks with Feature Selection

Estimation of Local and Global Superpixel Covariance for Salient Object Detection in Low Contrast Images

Salient Object Detection in Low Contrast Images Via Global Convolution and Boundary Refinement.

Visual Saliency Detection Based on Multiscale Deep CNN Features

CSA-Net: Deep Cross-Complementary Self Attention and Modality-Specific Preservation for Saliency Detection

A Spatial-Frequency-temporal Domain Based Saliency Model for Low Contrast Video Sequences

Finding autofocus region in low contrast surveillance images using CNN-based saliency algorithm

CNN for Saliency Detection with Low-Level Feature Integration.

Deep supervised visual saliency model addressing low-level features

Extended Non-Local Feature For Visual Saliency Detection In Low Contrast Images

Image Saliency Detection with Low-Level Features Enhancement.

Saliency Prediction Based on New Deep Multi-Layer Convolution Neural Network

An End-to-End Network for Co-Saliency Detection in One Single Image

Deep Contrast Learning for Salient Object Detection

Beyond Saliency: Understanding Convolutional Neural Networks from Saliency Prediction on Layer-Wise Relevance Propagation

Saliency detection using parallel non-linear integration of color and gradient using covariances

Contrast-Oriented Deep Neural Networks for Salient Object Detection

Co-learning Saliency Detection with Coupled Channels and Low-Rank Factorization

Research on Visual Saliency Model Based on CovSal Algorithm and Histogram Contrast

A Saliency Detection Model Combined Local And Global Features