Abstract:Salient motion detection is vital for security surveillance, pattern and motion recognition, traffic control, human–computer interaction, etc. Although such a subject has been very well investigated for analysis of stationary videos, many technical challenges still prevail when correctly handling and analyzing non-stationary videos recorded by hand-hold and pan-tilt-zoom cameras. To ameliorate, this paper develops a novel and robust salient motion detection method (especially valuable for quantitative analysis of non-stationary videos) by employing new computational strategies, including low-rank analysis aided by the divide-and-conquer approach, and exploration of the space–time semantic coherency. The key idea in our new approach is to respectively conduct multi-purpose low-rank analysis over a temporal series of well-decomposed frame-batches that have relatively-consistent backgrounds. First, we conduct bilateral random projection (BRP)-based low-rank analysis to accurately keep track of short-term stable-background observations, which consist of frames with similar global appearance and small local variations. Then, to eliminate the side effects due to visual variations induced by view angle changes, we incorporate the low-rank background prior into previous short-term observation to guide robust principal component analysis (RPCA) low-rank revealing based robust salient motion detection over current short-term observation. Meanwhile, a series of saliency clues extracted from the stabilized short-term observations are leveraged to expedite the proper updating of the low-rank background information, which enables us to effectively combat several obstinate problems. Finally, we conduct comprehensive experiments on the public CD2014 benchmark and other five non-stationary videos recorded from the hand-hold camera, and make extensive and quantitative evaluations with six state-of-the-art methods. Experimental results indicate that our method not only outperforms all other methods in the case of non-stationary videos but also obtains outstanding performance for stationary videos.

COROLA: A Sequential Solution to Moving Object Detection Using Low-rank Approximation

Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

Moving Object Detection Based on Incremental Learning Low Rank Representation and Spatial Constraint.

Moving Object Detection Via Low-Rank Total Variation Regularization

Detecting Moving Objects from Dynamic Background Combining Subspace Learning with Mixed Norm Approach

Masked-RPCA: Sparse and Low-rank Decomposition Under Overlaying Model and Application to Moving Object Detection

Robust Salient Motion Detection in Non-Stationary Videos Via Novel Integrated Strategies of Spatio-Temporal Coherency Clues and Low-Rank Analysis.

Background subtraction based on low-rank and structured sparse decomposition.

An Efficient Approach for Object Detection and Tracking of Objects in a Video with Variable Background

Beyond Local Search: Tracking Objects Everywhere with Instance-Specific Proposals

Moving Object Detection in Dynamic Environment Via Weighted Low-Rank Structured Sparse RPCA and Kalman Filtering

Outlier-Robust Moving Object and Background Decomposition via Structured <i>l<sub>p</sub></i>-Regularized Low-Rank Representation

Vision-Based Moving Objects Detection with Background Modeling

Multi-view Aggregation for Real-Time Accurate Object Detection of a Moving Camera

Object Detection by Spatio-Temporal Analysis and Tracking of the Detected Objects in a Video with Variable Background

An Efficient Approach of Moving Objects Detection in Complex Background

Moving Object Detection Using Tensor-Based Low-Rank and Saliently Fused-Sparse Decomposition.

Real-time Detection of the Moving Object in Video Sequences

An Improved Total Variation Regularized RPCA for Moving Object Detection with Dynamic Background

A Multilayer-Based Framework for Online Background Subtraction with Freely Moving Cameras