Abstract:This paper presents a transductive multicomponent video segmentation algorithm, which is capable of segmenting the predefined object of interest in the frames of a video sequence. To ensure temporal consistency, a temporal coherent parametric min-cut algorithm is developed to generate segmentation hypotheses based on visual cues and motion cues. Furthermore, each hypothesis is evaluated by an energy function from foreground resemblance, foreground/background divergence, boundary strength, and visual saliency. In particular, the state-of-the-art R-convolutional neural network descriptor is leveraged to encode the visual appearance of the foreground object. Finally, the optimal segmentation of the frame can be attained by assembling the segmentation hypotheses through the Monte Carlo approximation. In particular, multiple foreground components are built to capture the variances of the foreground object in shapes and poses. To group the frames into different components, a tree-structured graphical model named temporal tree is designed, where visually similar and temporally coherent frames are arranged in branches. The temporal tree can be constructed by iteratively adding frames to the active nodes by probabilistic clustering. In addition, each component, consisting of frames in the same branch, is characterized by a support vector machine classifier, which is learned in a transductive fashion by jointly maximizing the margin over the labeled frames and the unlabeled frames. As the frames from the same video sequence follow the same distribution, the transductive classifiers achieve stronger generalization capability than inductive ones. Experimental results on the public benchmarks demonstrate the effectiveness of the proposed method in comparison with other state-of-the-art supervised and unsupervised video segmentation methods.

Graph partition model for robust temporal data segmentation

A novel piecewise linear segmentation for time series

Improving the Controllability of Complex Networks by Temporal Segmentation

An Efficient Vertex-Driven Temporal Graph Model and Subgraph Clustering Method

Temporal Coherent Video Segmentation with Support Vector Machine and Graph Cut

Graph Partition by Swendsen-Wang Cuts

Identifying Vital Nodes On Temporal Networks: An Edge-Based K-Shell Decomposition

A Min-Max Cut Algorithm for Graph Partitioning and Data Clustering

Object Segmentation Using Graph Cuts for the H.264 Compressed Video with Moving Background

Efficient Maximal Frequent Group Enumeration in Temporal Bipartite Graphs

Research of image segmentation based on graph theory and minimum cut set algorithm

Revisiting graph construction for fast image segmentation

Transductive Video Segmentation on Tree-Structured Model

Visibility graph-based segmentation of multivariate time series data and its application

An FTP Algorithm for Temporal Graph Untangling

Normalized Tree Partitioning for Image Segmentation

A unified shot boundary detection framework based on graph partition model.

An Efficient Algorithm for Exact Segmentation of Large Compositional and Categorical Time Series

Efficient Video Object Segmentation by Graph-Cut

3D spatio-temporal graph cuts for video objects segmentation