Abstract:The research reported in this paper addresses the fundamental task of separation of locally moving or deforming image areas from a static or globally moving background. It builds on the latest developments in the field of robust principal component analysis, specifically, the recently reported practical solutions for the long-standing problem of recovering the low-rank and sparse parts of a large matrix made up of the sum of these two components. This article addresses a few critical issues including: embedding global motion parameters in the matrix decomposition model, i.e., estimation of global motion parameters simultaneously with the foreground/background separation task, considering matrix block-sparsity rather than generic matrix sparsity as natural feature in video processing applications, attenuating background ghosting effects when foreground is subtracted, and more critically providing an extremely efficient algorithm to solve the low-rank/sparse matrix decomposition task. The first aspect is important for background/foreground separation in generic video sequences where the background usually obeys global displacements originated by the camera motion in the capturing process. The second aspect exploits the fact that in video processing applications the sparse matrix has a very particular structure, where the non-zero matrix entries are not randomly distributed but they build small blocks within the sparse matrix. The next feature of the proposed approach addresses removal of ghosting effects originated from foreground silhouettes and the lack of information in the occluded background regions of the image. Finally, the proposed model also tackles algorithmic complexity by introducing an extremely efficient "SVD-free" technique that can be applied in most background/foreground separation tasks for conventional video processing.

Dynamic Mode Decomposition for Real-Time Background/Foreground Separation in Video

Multi-Resolution Analysis of Dynamical Systems Using Dynamic Mode Decomposition

Dynamic Mode Decomposition For Robust Pca With Applications To Foreground/Background Subtraction In Video Streams And Multi-Resolution Analysis

Multi-resolution Dynamic Mode Decomposition for Foreground/Background Separation and Object Tracking

Real-Time Motion Detection Using Dynamic Mode Decomposition

Background Subtraction Based on Nonparametric Bayesian Estimation.

Robust Kernelized Bayesian Matrix Factorization For Video Background/Foreground Separation

Video Foreground Detection by Low-Rank and Reweighted Sparse Decomposition

Dynamic Mode Decomposition and Its Variants

Joint Video Frame Set Division and Low-Rank Decomposition for Background Subtraction

Approximated Robust Principal Component Analysis for Improved General Scene Background Subtraction

Robust Dynamic Background Modeling for Foreground Estimation

Dynamic scenes reconstruction based on foreground and background splitting

Background subtraction in dynamic scenesusing the dynamic PCA

Robust PCA Using Matrix Factorization for Background/Foreground Separation

Dynamic Mode Decomposition Based Video Shot Detection.

Robust Bilayer Segmentation and Motion/Depth Estimation with a Handheld Camera

Robust Online Matrix Factorization for Dynamic Background Subtraction

Background subtraction based on low-rank and structured sparse decomposition.

Randomized Dynamic Mode Decomposition

Speeding uplow rank matrix recovery for foreground separation in surveillance videos