Abstract:Segmentation of video foreground objects from background has many important applications, such as human computer interaction, video compression, multimedia content editing and manipulation. Most existing methods work on image pixels or color segments which are computationally expensive. Some methods require extensive manual inputs, static cameras, and/or rigid scenes. In this paper we propose a fully automatic foreground segmentation method based on sequential clustering of sparse image features. The sparseness makes the method computationally efficient. We use both edge and corner points extracted from each video frame. A joint spatio-temporal linear regression method is developed to compute sparse motion layers of M consecutive frames jointly under the temporal consistency constraint. Once the sparse motion layers have been identified for each frame, the corresponding dense motion layers are created using the Markov Random Field (MRF) model. The MRF model assigns the rest of the image pixels to the motion layers by considering both the color attributes and the spatial relations between each pixel and its surrounding edge/corner points. Experimental evaluations on videos taken by webcams show the effectiveness of the proposed method.

Video Foreground Segmentation Based on Analysis of Spatial-Temporal Information

Adaptive Foreground and Shadow Segmentation Using Hidden Conditional Random Fields

A New Approach for Real-Time Segmenting Moving Objects under Cluttered Background

An algorithm for automatic segmentation of video objects based on intra-frame image partition

A Robust Foreground Segmentation Method by Temporal Averaging Multiple Video Frames

Video Foreground Segmentation Based on Sequential Feature Clustering

Efficient Foreground Layer Extraction In Video

An Effective Method for Foreground Segmentation of Video

Video Foreground Segmentation with Camera Movement

Efficient Foreground Segmentation Using an Image Matting Technology

Monocular Video Foreground/Background Segmentation by Tracking Spatial-Color Gaussian Mixture Models

Automatic Segmentation of Moving Objects in Video Sequences Based on Dynamic Background Construction

A Novel Algorithm to Segment Foreground from a Similarly Colored Background

Real-Time Foreground-Background Segmentation Using Adaptive Support Vector Machine Algorithm

Robust Bilayer Segmentation and Motion/Depth Estimation with a Handheld Camera

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Dynamic Background Estimation and Complementary Learning for Pixel-Wise Foreground/background Segmentation

Automatic Segmentation of Moving Objects in Video Sequences Based on Spatio-Temporal Information

Object Segmentation Using Graph Cuts for the H.264 Compressed Video with Moving Background

Transductive Segmentation of Live Video with Non-Stationary Background

Video object segmentation by motion-based sequential feature clustering.