Abstract:Recovering the background and foreground parts from video frames has important applications in video surveillance. Under the assumption that the background parts are stationary and the foreground are sparse, most of existing methods are based on the framework of robust principal component analysis (RPCA), i.e., modeling the background and foreground parts as a low-rank and sparse matrices, respectively. However, in realistic complex scenarios, the conventional norm sparse regularizer often fails to well characterize the varying sparsity of the foreground components. How to select the sparsity regularizer parameters adaptively according to the local statistics is critical to the success of the RPCA framework for background subtraction task. In this paper, we propose to model the sparse component with a Gaussian scale mixture (GSM) model. Compared with the conventional norm, the GSM-based sparse model has the advantages of jointly estimating the variances of the sparse coefficients (and hence the regularization parameters) and the unknown sparse coefficients, leading to significant estimation accuracy improvements. Moreover, considering that the foreground parts are highly structured, a structured extension of the GSM model is further developed. Specifically, the input frame is divided into many homogeneous regions using superpixel segmentation. By characterizing the set of sparse coefficients in each homogeneous region with the same GSM prior, the local dependencies among the sparse coefficients can be effectively exploited, leading to further improvements for background subtraction. Experimental results on several challenging scenarios show that the proposed method performs much better than most of existing background subtraction methods in terms of both performance and speed.

Robust Foreground Segmentation Based on Two Effective Background Models.

Background modeling using mixture of Gaussians and Laplacian pyramid decomposition.

Adaptive Foreground and Shadow Segmentation Using Hidden Conditional Random Fields

Flexible Background Mixture Models for Foreground Segmentation.

A Robust Foreground Segmentation Method by Temporal Averaging Multiple Video Frames

Robust Foreground Estimation via Structured Gaussian Scale Mixture Modeling

Robust Bilayer Segmentation and Motion/Depth Estimation with a Handheld Camera

Efficient Background Model Based on Multi-Level Feedback for Video Surveillance

Multi-Channel Adaptive Mixture Background Model for Real-time Tracking.

Robust Background Generation Based on an Effective Frames Selection Method and an Efficient Background Estimation Procedure (FSBE)

An Adaptive Background Modeling Method for Foreground Segmentation

Information Integration for Accurate Foreground Segmentation in Complex Scenes

Robust background subtraction in HSV color space

Video Background Segmentation Using Adaptive Background Models

Background Segmentation Using Spatial-Temporal Multi-Resolution MRF.

Dynamic Background Estimation and Complementary Learning for Pixel-Wise Foreground/background Segmentation

Coarse-to-fine Image Co-segmentation with Intra and Inter Rank Constraints

Robust Foreground Detection Using Smoothness And Arbitrariness Constraints

Foreground estimation based on robust linear regression model

Real-time Robust Background Subtraction under Rapidly Changing Illumination Conditions.

Robust Video Background Identification by Dominant Rigid Motion Estimation