Abstract:Saliency detection has been increasingly gaining research interest in recent years since many computer vision applications need to derive object attentions from images in the first steps. Multi-scale awareness of the saliency detector becomes essential to find thin and small attention regions as well as keeping high-level semantics. In this paper, we propose a novel holistic and deep feature pyramid neural network architecture that can leverage multi-scale semantics in feature encoding stage and saliency region prediction (decoding) stage. In the encoding stage, we exploit multi-scale and pyramidal hierarchy of feature maps via the densely connected network with variable-size dilated convolutions as well as a pyramid pooling. In the decoding stage, we fuse multi-level feature maps via up-sampling and convolution. In addition, we utilize the multi-level deep supervision via plugging in loss functions at every feature fusion level. Multi-loss supervision regularizes weights searching space among different tasks minimizing overfitting and enhances gradient signal during backpropagation, and thus enables us training the network from scratch. This architecture builds an inherent multi-level semantic pyramidal feature maps at different scales and enhances model’s capability in the saliency detection task. We validated our approach on six benchmark datasets and compared with Corresponding authors: Zhifan Gao (gaozhifan@gmail.com) and Heye Zhang (hy.zhang@siat.ac.cn) The National Natural Science Foundation of China (No: 61525106, 61427807,61771464), shenzhen innovation funding (JCYJ20170307165309009, JCYJ20170413114916687,SGLH20161212104605195) c © 2018. The copyright of this document resides with its authors. 2 29TH BRITISH MACHINE VISION CONFERENCE: BMVC2018 eleven state-of-the-art methods. The results demonstrated that the design effectiveness and our approach outperformed the compared methods.

Multi-Camera Saliency.

Saliency Detection Via Local Single Gaussian Model

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Salient Object Detection with High-Level Prior Based on Bayesian Fusion.

A multi-stage area saliency detection model

CSA-Net: Deep Cross-Complementary Self Attention and Modality-Specific Preservation for Saliency Detection

Holistic and Deep Feature Pyramids for Saliency Detection.

Video Saliency Detection via Dynamic Consistent Spatio-Temporal Attention Modelling.

Saliency Detection with Moving Camera via Background Model Completion

CNNs-Based RGB-D Saliency Detection Via Cross-View Transfer and Multiview Fusion.

DeepSaliency : MultiTask Deep Neural Network Model for Salient Object Detection

A structure-guided approach to the prediction of natural image saliency

Visual saliency detection by integrating spatial position prior of object with background cues

An Innovative Saliency Detection Framework with an Example of Image Montage

Saliency Prediction with Scene Structural Guidance

Saliency Detection Based on Multiple-Level Feature Learning

Salient Object Detection Via Multiple Saliency Weights

Multi-View Video Quality Enhancement Method Based on Multi-Scale Fusion Convolutional Neural Network and Visual Saliency

Probabilistic Multi-Task Learning for Visual Saliency Estimation in Video

Co-saliency Detection via Sparse Reconstruction and Co-salient Object Discovery.

Multicam-SLAM: Non-overlapping Multi-camera SLAM for Indirect Visual Localization and Navigation