Abstract:Saliency detection has been increasingly gaining research interest in recent years since many computer vision applications need to derive object attentions from images in the first steps. Multi-scale awareness of the saliency detector becomes essential to find thin and small attention regions as well as keeping high-level semantics. In this paper, we propose a novel holistic and deep feature pyramid neural network architecture that can leverage multi-scale semantics in feature encoding stage and saliency region prediction (decoding) stage. In the encoding stage, we exploit multi-scale and pyramidal hierarchy of feature maps via the densely connected network with variable-size dilated convolutions as well as a pyramid pooling. In the decoding stage, we fuse multi-level feature maps via up-sampling and convolution. In addition, we utilize the multi-level deep supervision via plugging in loss functions at every feature fusion level. Multi-loss supervision regularizes weights searching space among different tasks minimizing overfitting and enhances gradient signal during backpropagation, and thus enables us training the network from scratch. This architecture builds an inherent multi-level semantic pyramidal feature maps at different scales and enhances model’s capability in the saliency detection task. We validated our approach on six benchmark datasets and compared with Corresponding authors: Zhifan Gao (gaozhifan@gmail.com) and Heye Zhang (hy.zhang@siat.ac.cn) The National Natural Science Foundation of China (No: 61525106, 61427807,61771464), shenzhen innovation funding (JCYJ20170307165309009, JCYJ20170413114916687,SGLH20161212104605195) c © 2018. The copyright of this document resides with its authors. 2 29TH BRITISH MACHINE VISION CONFERENCE: BMVC2018 eleven state-of-the-art methods. The results demonstrated that the design effectiveness and our approach outperformed the compared methods.

Learning a Deep Representative Saliency Map with Sparse Tensors

Visual Saliency Detection Based on In-Depth Analysis of Sparse Representation

Holistic and Deep Feature Pyramids for Saliency Detection.

Saliency Analysis via Hyperparameter Sparse Representation and Energy Distribution Optimization for Remote Sensing Images

Accurate salient object detection via dense recurrent connections and residual-based hierarchical feature integration.

Leveraging Human Fixations in Sparse Coding: Learning a Discriminative Dictionary for Saliency Prediction.

Sparsity-guided saliency detection for remote sensing images

An Object-Oriented Visual Saliency Detection Framework Based on Sparse Coding Representations

Robust Tensor Low-Rank Sparse Representation with Saliency Prior for Hyperspectral Anomaly Detection

Visual Saliency Detection Via Sparsity Pursuit.

Visual Saliency Detection Via Rank-Sparsity Decomposition

A Deep Spatial Contextual Long-term Recurrent Convolutional Network for Saliency Detection

Image super resolution using saliency-modulated context-aware sparse decomposition

Salient Object Detection Employing Robust Sparse Representation and Local Consistency

Image Super Resolution Based on Salient Sparse Coding

Image Super-Resolution via Hierarchical and Collaborative Sparse Representation

Learning Saliency Prediction From Sparse Fixation Pixel Map

DISC: Deep Image Saliency Computing via Progressive Representation Learning

Video Saliency Prediction using Spatiotemporal Residual Attentive Networks.

A VHR Scene Classification Method Integrating Sparse PCA and Saliency Computing

Human Vision Attention Mechanism-Inspired Temporal-Spatial Feature Pyramid for Video Saliency Detection