Abstract:Extracting spatio-temporally consistent segments from a video sequence is a challenging problem due to the complexity of color, motion and occlusions. Most existing spatio-temporal segmentation approaches rely on pairwise motion estimation, which have inherent difficulties in handling large displacement with significant occlusions. This paper presents a novel spatio-temporal segmentation method for depth-inferred videos. The depth data of input videos can be estimated beforehand using a multiview stereo technique. Our framework consists of two steps. In the first step, in order to make the extracted 2D segments temporally consistent, we introduce a spatial segmentation based on the probabilistic boundary maps, by collecting the boundary statistics in a video. In the second step, the consistent 2D segments in different frames are matched to initialize the volume segments. Then we compute the segment probability for each pixel by projecting it to other frames to collect the statistics, and incorporate it into the spatio-temporal segmentation energy to explicitly enforce temporal coherence constraint. The spatio-temporal segmentation results are iteratively refined in a video, so that a set of spatio-temporally consistent volume segments are finally achieved. The effectiveness of our automatic method is demonstrated using a variety of challenging video examples.

Dynamic Programming Based Video Segmentation

Motionobject segmentation algorithm based on spatial-temporal information

A Moving Object Segmentation Technique Using Dynamic Programming

An algorithm for automatic segmentation of video objects based on intra-frame image partition

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

An Adaptive Frame Skipping and Vop Interpolation Algorithm for Video Object Segmentation

Real-time spatiotemporal segmentation of video objects in the H.264 compressed domain

Efficient motion segmentation for H.264 compressed video

Video Segmentation Based on Inte R-Frame Motion

Automatic Segmentation of Moving Objects in Video Sequences Using Multifeature

RGB-D Video Segmentation via Geodesic Spatio-Temporal Propagation

Semi-automatic Video Object Segmentation Using Seeded Region Merging and Bidirectional Projection

Real Time Image Sequence Segmentation Using Curve Evolution

Robust Bilayer Segmentation and Motion/Depth Estimation with a Handheld Camera

Improved Intelligent Scissors and Snake based VOP Interpolation for Semiautomatic Video Object Segmentation

Transductive Segmentation of Live Video with Non-Stationary Background

Spatio-Temporal Segmentation with Depth-Inferred Videos of Static Scenes

Objective Performance Evaluation of Video Segmentation Algorithms with Ground-Truth

User-assisted Video Segmentation System for Visual Communication.

Video Scene Segmentation Using a Novel Boundary Evaluation Criterion and Dynamic Programming

Motion Objects Segmentation Using a New Level Set Based Method