Abstract:Extracting spatio-temporally consistent segments from a video sequence is a challenging problem due to the complexity of color, motion and occlusions. Most existing spatio-temporal segmentation approaches rely on pairwise motion estimation, which have inherent difficulties in handling large displacement with significant occlusions. This paper presents a novel spatio-temporal segmentation method for depth-inferred videos. The depth data of input videos can be estimated beforehand using a multiview stereo technique. Our framework consists of two steps. In the first step, in order to make the extracted 2D segments temporally consistent, we introduce a spatial segmentation based on the probabilistic boundary maps, by collecting the boundary statistics in a video. In the second step, the consistent 2D segments in different frames are matched to initialize the volume segments. Then we compute the segment probability for each pixel by projecting it to other frames to collect the statistics, and incorporate it into the spatio-temporal segmentation energy to explicitly enforce temporal coherence constraint. The spatio-temporal segmentation results are iteratively refined in a video, so that a set of spatio-temporally consistent volume segments are finally achieved. The effectiveness of our automatic method is demonstrated using a variety of challenging video examples.

Video Stream Segmentation Method Based on Video Page

Video Shot Segmentation Method Using Linear Segmentation and Sequences Combination

A Method of Simultaneously Action Recognition and Video Segmentation of Video Streams.

An algorithm for automatic segmentation of video objects based on intra-frame image partition

Color Correction Method Based on Histogram Segmentation for Multiview Video

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

Visual Attention Based Video Object Segmentation in MPEG Compressed Domain

Video stream interception and erotic content filtering

Video Segmentation Based On Sequential Change Detection

An object segmentation method for the color slow-motion videos based on adjacent frames gradual change

Real-time spatiotemporal segmentation of video objects in the H.264 compressed domain

Multi-scale Shot Segmentation Based on Weighted Subregion Color Histogram.

Scene Segmentation Based on Video Structure and Spectral Methods

Video Scene Segmentation Using Sequential Change Detection

RGB-D Video Segmentation via Geodesic Spatio-Temporal Propagation

A Method of Video Quality Assessment Based on the Sensitive Region.

Object segmentation based on disparity estimation

Spatio-Temporal Segmentation with Depth-Inferred Videos of Static Scenes

Efficient video object segmentation based on Gaussian mixture model and Markov random field

Video Co-Saliency Guided Co-Segmentation

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications