Abstract:Extracting spatio-temporally consistent segments from a video sequence is a challenging problem due to the complexity of color, motion and occlusions. Most existing spatio-temporal segmentation approaches rely on pairwise motion estimation, which have inherent difficulties in handling large displacement with significant occlusions. This paper presents a novel spatio-temporal segmentation method for depth-inferred videos. The depth data of input videos can be estimated beforehand using a multiview stereo technique. Our framework consists of two steps. In the first step, in order to make the extracted 2D segments temporally consistent, we introduce a spatial segmentation based on the probabilistic boundary maps, by collecting the boundary statistics in a video. In the second step, the consistent 2D segments in different frames are matched to initialize the volume segments. Then we compute the segment probability for each pixel by projecting it to other frames to collect the statistics, and incorporate it into the spatio-temporal segmentation energy to explicitly enforce temporal coherence constraint. The spatio-temporal segmentation results are iteratively refined in a video, so that a set of spatio-temporally consistent volume segments are finally achieved. The effectiveness of our automatic method is demonstrated using a variety of challenging video examples.

Motion Segmentation Model Based on Total Variation and Split Bregman Algorithm

Fast Global Segmentation Based on the Dual Formulation of TV-norm

Motionobject segmentation algorithm based on spatial-temporal information

Vibration-resisted video segmentation algorithm based on hierarchical Markov random field model

Convex Relaxation for a 3D Spatiotemporal Segmentation Model Using the Primal-Dual Method

Motion Objects Segmentation Using a New Level Set Based Method

3D Video Based Segmentation and Motion Estimation with Active Surface Evolution

An Image Segmentation Model with Transformed Total Variation

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Variational Model for Image Segmentation.

Spatio-Temporal Segmentation with Depth-Inferred Videos of Static Scenes

Contour Based Automatic Scene Segmentation in Image Sequences

A variational approach for ego-motion estimation and segmentation based on 3D TOF camera

An Efficient Compressed Domain Moving Object Segmentation Algorithm Based on Motion Vector Field

A Hybride Active Contour Model Driven by Global and Local Image Information

Efficient motion segmentation for H.264 compressed video

Contour-Based Motion Segmentation Using Few Priors

A Spatiotemporal Multiple Moving Objects Segmentation and Tracking with Level Set

Segmenting the motion components of a video: A long-term unsupervised model

A Three-Stage Variational Image Segmentation Framework Incorporating Intensity Inhomogeneity Information

Primal-dual method for spatiotemporal tracking model with moving background