Abstract:We present a novel, robust estimation method to distinguish salient objects from complicated, dynamic backgrounds in videos. In this method, we propose a novel approach to model motion energy based on motion magnitude, motion orientation, gradient flow field, and spatial gradient of the video frame. Furthermore, an effective spatiotemporal objectness map is also proposed to estimate a compact object-like region in the current video frame leveraging both the objectness proposals and the saliency map of the previous frame. Then the current video frame is oversegmented into the granularity of superpixels using the simple linear iterative clustering algorithm. Each superpixel is designated as a node of a graph. The similarity between adjacent superpixels will be assigned as the weight of an edge that connects these two nodes. The feature values of motion energy and spatiotemporal objectness within each superpixel will be averaged respectively, and used to graphically cluster similar superpixels to form the detected salient object. Extensive experiments comparing this proposed new method against twelve existing salient object detection (SOD) methods have been performed using the benchmark datasets unconstrained video saliency detection and densely annotated video segmentation. Superior performance of this proposed SOD method has been observed through three well-known performance metrics: precision-recall curves, F-measure curves, and the mean absolute error.

Video Attention: Learning to Detect a Salient Object Sequence

Automatic Salient Object Sequence Rebuilding for Video Segment Analysis

Local Attention Sequence Model for Video Object Detection

Detection of Salient Objects with Focused Attention Based on Spatial and Temporal Coherence

Visual Attention Based Video Object Segmentation in MPEG Compressed Domain

Video Salient Object Detection via Contrastive Features and Attention Modules

Saliency-Aware Video Object Segmentation.

Learning to Detect A Salient Object

Video Abstraction via Attention Model and On-Line Clustering

Video-based Salient Object Detection Via Spatio-Temporal Difference and Coherence

Video Saliency Detection via Dynamic Consistent Spatio-Temporal Attention Modelling.

Automatic Segmentation of Objects of Interest in Video: a Unified Framework

Video Saliency Detection Using Object Proposals

Interesting moving object segmentation based on selective visual attention and Markov random field

Spatial-Temporal Salient Unit Detection Based on Features in Video Sequences

Video Salient Object Detection via Robust Seeds Extraction and Multi-Graphs Manifold Propagation

A Video Salient Object Detection Model Guided By Spatio-Temporal Prior

Object Segmentation from Consumer Videos: a Unified Framework Based on Visual Attention

Visual saliency based object tracking

Video Saliency Detection Via Graph Clustering with Motion Energy and Spatiotemporal Objectness

Salient Objects Detection In Time Sequenced Images