Abstract:This paper presents a transductive multicomponent video segmentation algorithm, which is capable of segmenting the predefined object of interest in the frames of a video sequence. To ensure temporal consistency, a temporal coherent parametric min-cut algorithm is developed to generate segmentation hypotheses based on visual cues and motion cues. Furthermore, each hypothesis is evaluated by an energy function from foreground resemblance, foreground/background divergence, boundary strength, and visual saliency. In particular, the state-of-the-art R-convolutional neural network descriptor is leveraged to encode the visual appearance of the foreground object. Finally, the optimal segmentation of the frame can be attained by assembling the segmentation hypotheses through the Monte Carlo approximation. In particular, multiple foreground components are built to capture the variances of the foreground object in shapes and poses. To group the frames into different components, a tree-structured graphical model named temporal tree is designed, where visually similar and temporally coherent frames are arranged in branches. The temporal tree can be constructed by iteratively adding frames to the active nodes by probabilistic clustering. In addition, each component, consisting of frames in the same branch, is characterized by a support vector machine classifier, which is learned in a transductive fashion by jointly maximizing the margin over the labeled frames and the unlabeled frames. As the frames from the same video sequence follow the same distribution, the transductive classifiers achieve stronger generalization capability than inductive ones. Experimental results on the public benchmarks demonstrate the effectiveness of the proposed method in comparison with other state-of-the-art supervised and unsupervised video segmentation methods.

Connectivity Similarity Based Transductive Learning for Interactive Image Segmentation

Locally Biased Discriminative Clustering Method for Interactive Image Segmentation.

Interactive Image Segmentation with Multiple Linear Reconstructions in Windows

Interactive Object Segmentation Using Kernel Density Estimation Based Graph Cuts

Graph-without-cut: an Ideal Graph Learning for Image Segmentation

Interactive Image Segmentation Based on Label Pair Diffusion

Sparse Graph Connectivity for Image Segmentation

Online-GCN: An Online Interactive Segmentation Method Based on Graph Convolutional Network

Interactive Cell Segmentation Based on Active and Semi-Supervised Learning

Robust image segmentation against complex color distribution

Learning from Exemplars for Interactive Image Segmentation

Interactive Image Segmentation Based on Samples Reconstruction and FLDA

Combination of Region and Contour Models for Interactive Image Segmentation

Interactive RGB-D Image Segmentation Using Hierarchical Graph Cut and Geodesic Distance

Focused and Collaborative Feedback Integration for Interactive Image Segmentation.

Transductive Video Segmentation on Tree-Structured Model

Adaptive hypergraph learning and its application in image classification.

Directional Connectivity-based Segmentation of Medical Images

Regional Interactive Image Segmentation Networks

One-Click-Based Perception for Interactive Image Segmentation

LinedCut: Image segmentation using single line interaction