Abstract:Deep convolutional neural networks have become a key element in the recent breakthrough of salient object detection. However, existing CNN-based methods are based on either patch-wise (region-wise) training and inference or fully convolutional networks. Methods in the former category are generally time-consuming due to severe storage and computational redundancies among overlapping patches. To overcome this deficiency, methods in the second category attempt to directly map a raw input image to a predicted dense saliency map in a single network forward pass. Though being very efficient, it is arduous for these methods to detect salient objects of different scales or salient regions with weak semantic information. In this paper, we develop hybrid contrast-oriented deep neural networks to overcome the aforementioned limitations. Each of our deep networks is composed of two complementary components, including a fully convolutional stream for dense prediction and a segment-level spatial pooling stream for sparse saliency inference. We further propose an attentional module that learns weight maps for fusing the two saliency predictions from these two streams. A tailored alternate scheme is designed to train these deep networks by fine-tuning pre-trained baseline models. Finally, a customized fully connected CRF model incorporating a salient contour feature embedding can be optionally applied as a post-processing step to improve spatial coherence and contour positioning in the fused result from these two streams. Extensive experiments on six benchmark datasets demonstrate that our proposed model can significantly outperform the state of the art in terms of all popular evaluation metrics.

Overview of deep-learning based methods for salient object detection in videos

Video Salient Object Detection via Fully Convolutional Networks

Recent advances in deep learning for object detection

New Generation Deep Learning for Video Object Detection: A Survey

Salient Object Detection in the Deep Learning Era: An In-Depth Survey

Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection: A Survey

A Survey of Deep Learning-based Object Detection

Investigations of Object Detection in Images/Videos Using Various Deep Learning Techniques and Embedded Platforms—A Comprehensive Review

Video-based Salient Object Detection Via Spatio-Temporal Difference and Coherence

Deep Learning for Video Saliency Detection.

Deep learning based object detection from multi-modal sensors: an overview

A survey and performance evaluation of deep learning methods for small object detection

Saliency detection in deep learning era: trends of development

A survey of modern deep learning based object detection models

Video Salient Object Detection via Robust Seeds Extraction and Multi-Graphs Manifold Propagation

Object Detection with Deep Learning: A Review

DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection

Contrast-Oriented Deep Neural Networks for Salient Object Detection

A Novel Video Salient Object Detection Method via Semi-supervised Motion Quality Perception

Video Saliency Detection Using Object Proposals