Abstract:Salient motion detection is vital for security surveillance, pattern and motion recognition, traffic control, human–computer interaction, etc. Although such a subject has been very well investigated for analysis of stationary videos, many technical challenges still prevail when correctly handling and analyzing non-stationary videos recorded by hand-hold and pan-tilt-zoom cameras. To ameliorate, this paper develops a novel and robust salient motion detection method (especially valuable for quantitative analysis of non-stationary videos) by employing new computational strategies, including low-rank analysis aided by the divide-and-conquer approach, and exploration of the space–time semantic coherency. The key idea in our new approach is to respectively conduct multi-purpose low-rank analysis over a temporal series of well-decomposed frame-batches that have relatively-consistent backgrounds. First, we conduct bilateral random projection (BRP)-based low-rank analysis to accurately keep track of short-term stable-background observations, which consist of frames with similar global appearance and small local variations. Then, to eliminate the side effects due to visual variations induced by view angle changes, we incorporate the low-rank background prior into previous short-term observation to guide robust principal component analysis (RPCA) low-rank revealing based robust salient motion detection over current short-term observation. Meanwhile, a series of saliency clues extracted from the stabilized short-term observations are leveraged to expedite the proper updating of the low-rank background information, which enables us to effectively combat several obstinate problems. Finally, we conduct comprehensive experiments on the public CD2014 benchmark and other five non-stationary videos recorded from the hand-hold camera, and make extensive and quantitative evaluations with six state-of-the-art methods. Experimental results indicate that our method not only outperforms all other methods in the case of non-stationary videos but also obtains outstanding performance for stationary videos.

An Adaptive Approach for Salient Motion in Dynamic Scenes

A New Approach for Salient Motion in Dynamic Scenes

Adaptive Hierarchical Motion-Focused Model for Video Prediction.

Robust Salient Motion Detection in Non-Stationary Videos Via Novel Integrated Strategies of Spatio-Temporal Coherency Clues and Low-Rank Analysis.

Unsupervised Dynamic Texture Segmentation Using Appearance and Motion

Camera Pose Estimation in Dynamic Scenes with Background Tracking

Video Identification Using Spatio-temporal Salient Points

Multi-Channel Adaptive Mixture Background Model for Real-time Tracking.

Spatio-Temporal Segmentation with Depth-Inferred Videos of Static Scenes

Motion Detection for Rapidly Moving Cameras in Fully 3D Scenes

Motion-Aware Rapid Video Saliency Detection

Automatic Dynamic Texture Segmentation Using Local Descriptors and Optical Flow

Predictive Video Saliency Detection.

Dynamical Textures Modeling Via Joint Video Dictionary Learning

Motion Saliency Detection Using A Temporal Fourier Transform

Spatiotemporal Saliency Based on Opponent Oriented Energy for Background Subtraction in Complex Scenes

Temporally Coherent Video Saliency Using Regional Dynamic Contrast

Surveillance Video Coding with Dynamic Textural Background Detection

DATAP-SfM: Dynamic-Aware Tracking Any Point for Robust Structure from Motion in the Wild

Robust Video Background Identification by Dominant Rigid Motion Estimation

Dynamic texture synthesis using a spatial temporal descriptor