Abstract:Foreground detection is one of the key steps in computer vision applications. Many foreground and background models have been proposed and achieved promising performance in static scenes. However, due to challenges such as dynamic background, irregular movement, and noise, most algorithms degrade sharply in complex scenes. To address the problem, we propose a motion-aware structured matrix factorization approach (MSMF), which integrates the structural and spatiotemporal motion information into a unified sparse-low-rank matrix factorization framework. Technologically, it has three main contributions: First, a variant of structured sparsity-inducing norm is proposed to constrain both structure and sparsity of foreground. The model is robust to the statistical variability of the underlying foreground pixels in complex scenes. Second, to capture the ambiguous pixels, a spatiotemporal cube-based motion trajectory is extracted for assisting matrix factorization. Finally, to solve the optimization problem of structured matrix factorization, we develop an augmented Lagrange multiplier method with the alternating direction strategy and Douglas-Rachford monotone operator splitting algorithm. Experiments demonstrate that the proposed approach achieves impressive performance in separating irregular moving foreground while suppressing the dynamic background and the noise, and outperforms some state-of-the-art algorithms.

A multiscale spatio-temporal background model for motion detection

Motion Detection for Rapidly Moving Cameras in Fully 3D Scenes

Multi-Channel Adaptive Mixture Background Model for Real-time Tracking.

Moving Object Detection of Dynamic Scenes Using Spatio-Temporal Context and Background Modeling

Vision-Based Moving Objects Detection with Background Modeling

Detecting Moving Objects from Dynamic Background Combining Subspace Learning with Mixed Norm Approach

A temporal-spatial background modeling of dynamic scenes

A background model estimation algorithm based on analysis of local motion for video surveillance

HOG-based Multi-Scale Motion Detection

A Fuzzy Background Model For Moving Object Detection

Motion-Based Background Subtraction

Efficient Background Model Based on Multi-Level Feedback for Video Surveillance

Motion-Aware Structured Matrix Factorization for Foreground Detection in Complex Scenes

Spatially Adaptive Subsampling for Motion Detection

Two-Dimension Principal Component Analysis-Based Motion Detection Framework with Subspace Update of Background

Background modeling by subspace learning on spatio-temporal patches

Camera Pose Estimation in Dynamic Scenes with Background Tracking

Complex Background Subtraction by Pursuing Dynamic Spatio-Temporal Models

Background Subtraction Through Multiple Life Span Modeling

Shape Prior Based Moving Object Detection

Adaptive Background Model Based on Hybrid Structure Neural Network