Abstract:The recently proposed robust principle component analysis (RPCA) has been successfully applied in background subtraction. However, low-rank decomposition makes sense on the condition that the foreground pixels (sparsity patterns) are uniformly located at the scene, which is not realistic in real-world applications. To overcome this limitation, we reconstruct the input video frames and aim to make the foreground pixels not only sparse in space but also sparse in time. Therefore, we propose a joint video frame set division and RPCA-based method for background subtraction. In addition, we use the motion as a priori knowledge which has not been considered in the current subspace-based methods. The proposed method consists of two phases. In the first phase, we propose a lower bound-based within-class maximum division method to divide the video frame set into several subsets. In this way, the successive frames are assigned to different subsets in which the foregrounds are located at the scene randomly. In the second phase, we augment each subset using the frames with a small quantity of motion. To evaluate the proposed method, the experiments are conducted on real-world and public datasets. The comparisons with the state-of-the-art background subtraction methods validate the superiority of our method.

Background Subtraction with Moving Cameras Via Bayesian Low-Rank Estimation

Background Subtraction Based on Nonparametric Bayesian Estimation.

Background subtraction based on low-rank and structured sparse decomposition.

Robust Estimation for Background Subtraction

Background Subtraction Based on Integration of Alternative Cues in Freely Moving Camera

Motion-Based Background Subtraction

A Multilayer-Based Framework for Online Background Subtraction with Freely Moving Cameras

Detecting Moving Objects from Dynamic Background Combining Subspace Learning with Mixed Norm Approach

Background Subtraction Using Incremental Subspace Learning

Background Subtraction Using Dual-Class Backgrounds

Joint Video Frame Set Division and Low-Rank Decomposition for Background Subtraction

Multi-Channel Adaptive Mixture Background Model for Real-time Tracking.

Background subtraction via time continuity and texture consistency constraints.

Adaptive pixel-block based background subtraction using low-rank and block-sparse matrix decomposition

Fast Background Subtraction for Moving Cameras Based on Nonparametric Models

Background Subtraction for Moving Cameras Based on Trajectory-controlled Segmentation and Label Inference

Background Subtraction Based on Adaptive Non-Parametric Model

Local spatial co-occurrence for background subtraction via adaptive binned kernel estimation

Complex Background Subtraction by Pursuing Dynamic Spatio-Temporal Models

A Real-Time Background Subtraction Algorithm for Freely Moving Cameras

Coarse-to-fine Sample-Based Background Subtraction for Moving Object Detection