Abstract:Salient motion detection is vital for security surveillance, pattern and motion recognition, traffic control, human–computer interaction, etc. Although such a subject has been very well investigated for analysis of stationary videos, many technical challenges still prevail when correctly handling and analyzing non-stationary videos recorded by hand-hold and pan-tilt-zoom cameras. To ameliorate, this paper develops a novel and robust salient motion detection method (especially valuable for quantitative analysis of non-stationary videos) by employing new computational strategies, including low-rank analysis aided by the divide-and-conquer approach, and exploration of the space–time semantic coherency. The key idea in our new approach is to respectively conduct multi-purpose low-rank analysis over a temporal series of well-decomposed frame-batches that have relatively-consistent backgrounds. First, we conduct bilateral random projection (BRP)-based low-rank analysis to accurately keep track of short-term stable-background observations, which consist of frames with similar global appearance and small local variations. Then, to eliminate the side effects due to visual variations induced by view angle changes, we incorporate the low-rank background prior into previous short-term observation to guide robust principal component analysis (RPCA) low-rank revealing based robust salient motion detection over current short-term observation. Meanwhile, a series of saliency clues extracted from the stabilized short-term observations are leveraged to expedite the proper updating of the low-rank background information, which enables us to effectively combat several obstinate problems. Finally, we conduct comprehensive experiments on the public CD2014 benchmark and other five non-stationary videos recorded from the hand-hold camera, and make extensive and quantitative evaluations with six state-of-the-art methods. Experimental results indicate that our method not only outperforms all other methods in the case of non-stationary videos but also obtains outstanding performance for stationary videos.

Criminal Investigation Oriented Saliency Detection for Surveillance Videos

Salient object detection in image sequences via spatial-temporal cue

Video Saliency Detection Using Spatiotemporal Cues

Video Saliency Detection Using Multi-Level Spatiotemporal Orientation.

Video Saliency Detection via Dynamic Consistent Spatio-Temporal Attention Modelling.

A Video Salient Object Detection Model Guided By Spatio-Temporal Prior

Salient Object Detection in Video Based on Dynamic Attention Center.

Robust Salient Motion Detection in Non-Stationary Videos Via Novel Integrated Strategies of Spatio-Temporal Coherency Clues and Low-Rank Analysis.

A Novel Spatial Information Model for Saliency Detection.

Traffic Sign Detection Based on Visual Co-Saliency in Complex Scenes

Detection of Salient Objects with Focused Attention Based on Spatial and Temporal Coherence

A Spatiotemporal Weighted Dissimilarity-Based Method for Video Saliency Detection

Video Saliency Map Detection Based on Global Motion Estimation.

Motion salient detection based on region-of-non-interest spatial-temporal analysis

Improving Video Saliency Detection Via Localized Estimation and Spatiotemporal Refinement.

Video-based Salient Object Detection Via Spatio-Temporal Difference and Coherence

Video saliency detection by spatio-temporal sampling and sparse matrix decomposition

A novel visual saliency detection method for infrared video sequences

Saliency Detection in Complex Scenes.

Video Saliency Detection Via Graph Clustering with Motion Energy and Spatiotemporal Objectness

Predictive Video Saliency Detection.