Abstract:The research reported in this paper addresses the fundamental task of separation of locally moving or deforming image areas from a static or globally moving background. It builds on the latest developments in the field of robust principal component analysis, specifically, the recently reported practical solutions for the long-standing problem of recovering the low-rank and sparse parts of a large matrix made up of the sum of these two components. This article addresses a few critical issues including: embedding global motion parameters in the matrix decomposition model, i.e., estimation of global motion parameters simultaneously with the foreground/background separation task, considering matrix block-sparsity rather than generic matrix sparsity as natural feature in video processing applications, attenuating background ghosting effects when foreground is subtracted, and more critically providing an extremely efficient algorithm to solve the low-rank/sparse matrix decomposition task. The first aspect is important for background/foreground separation in generic video sequences where the background usually obeys global displacements originated by the camera motion in the capturing process. The second aspect exploits the fact that in video processing applications the sparse matrix has a very particular structure, where the non-zero matrix entries are not randomly distributed but they build small blocks within the sparse matrix. The next feature of the proposed approach addresses removal of ghosting effects originated from foreground silhouettes and the lack of information in the occluded background regions of the image. Finally, the proposed model also tackles algorithmic complexity by introducing an extremely efficient "SVD-free" technique that can be applied in most background/foreground separation tasks for conventional video processing.

Robust Background Identification for Dynamic Video Editing

Robust Video Background Identification by Dominant Rigid Motion Estimation

Robust Bilayer Segmentation and Motion/Depth Estimation with a Handheld Camera

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

Camera Pose Estimation in Dynamic Scenes with Background Tracking

New Method Of Background Update For Video-Based Vehicle Detection

A New Approach for Real-Time Segmenting Moving Objects under Cluttered Background

Background feature point identification method and device in dynamic video editing

Moving Object Extraction with a Hand-held Camera

Efficient Silhouette Extraction with Dynamic Viewpoint.

A Multilayer-Based Framework for Online Background Subtraction with Freely Moving Cameras

Motion-Based Background Subtraction

Robust Camera Motion Estimation in Video Sequences

Live Video Montage with a Rotating Camera

Dynamic scenes reconstruction based on foreground and background splitting

Dynamic Background Estimation and Complementary Learning for Pixel-Wise Foreground/background Segmentation

Object Segmentation Using Graph Cuts for the H.264 Compressed Video with Moving Background

Approximated Robust Principal Component Analysis for Improved General Scene Background Subtraction

Automatic foreground extraction in video

Video Foreground Segmentation with Camera Movement

Slippage-free Background Replacement for Hand-Held Video