Abstract:Extracting spatio-temporally consistent segments from a video sequence is a challenging problem due to the complexity of color, motion and occlusions. Most existing spatio-temporal segmentation approaches rely on pairwise motion estimation, which have inherent difficulties in handling large displacement with significant occlusions. This paper presents a novel spatio-temporal segmentation method for depth-inferred videos. The depth data of input videos can be estimated beforehand using a multiview stereo technique. Our framework consists of two steps. In the first step, in order to make the extracted 2D segments temporally consistent, we introduce a spatial segmentation based on the probabilistic boundary maps, by collecting the boundary statistics in a video. In the second step, the consistent 2D segments in different frames are matched to initialize the volume segments. Then we compute the segment probability for each pixel by projecting it to other frames to collect the statistics, and incorporate it into the spatio-temporal segmentation energy to explicitly enforce temporal coherence constraint. The spatio-temporal segmentation results are iteratively refined in a video, so that a set of spatio-temporally consistent volume segments are finally achieved. The effectiveness of our automatic method is demonstrated using a variety of challenging video examples.

Multi-resolution Video Segmentation Algorithm Based on 3D Body

Motionobject segmentation algorithm based on spatial-temporal information

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

An algorithm for automatic segmentation of video objects based on intra-frame image partition

Vibration-resisted video segmentation algorithm based on hierarchical Markov random field model

Multiresolution Segmentation of Video Objects in the Compression Domain

Spatio-Temporal Segmentation with Depth-Inferred Videos of Static Scenes

Simultaneous multi-body stereo and segmentation

Non-rigid Video Object Segmentation Based on Semantic Multi-level Framework.

Motion Objects Segmentation Using a New Level Set Based Method

New Real-Time Algorithm for Multiview Disparity-Based 3D-Object Segmentation.

Object segmentation based on disparity estimation

Contour Based Automatic Scene Segmentation in Image Sequences

Real-time spatiotemporal segmentation of video objects in the H.264 compressed domain

THREE-DIMENSIONAL ANIMATION COMPRESSION BASED ON SPACE-TIME SEGMENTATION

Improved Intelligent Scissors and Snake based VOP Interpolation for Semiautomatic Video Object Segmentation

Multi-View Video Based Multiple Objects Segmentation Using Graph Cut and Spatiotemporal Projections

A New Algorithm of Multi-hierarchy Semantic Video Object Segmentation

An automatic segmentation algorithm for moving objects in video sequences under multi-constraints

Efficient Multi-scale Plane Extraction Based RGBD Video Segmentation