Abstract:This paper presents an interactive image segmentation framework which is ultra-fast and accurate. Our framework, termed "CO3", consists of three components: COupled representation, COnditional model and COnvex inference. (i) In representation, we pose the segmentation problem as partitioning an image domain into regions (foreground vs. background) or boundaries (on vs. off) which are dual but simultaneously compete with each other. Then, we formulate segmentation process as a combinatorial posterior ratio test in both the region and boundary partition space. (ii) In modeling, we use discriminative learning methods to train conditional models for both region and boundary based on interactive scribbles. We exploit rich image features at multi-scales, and simultaneously incorporate user's intention behind the interactive scribbles. (iii) In computing, we relax the energy function into an equivalent continuous form which is convex. Then, we adopt the Bregman iteration method to enforce the "coupling" of region and boundary terms with fast global convergence. In addition, a multigrid technique is further introduced, which is a coarse-to-fine mechanism and guarantees both feature discriminativeness and boundary preciseness by adjusting the size of image features gradually. The proposed interactive system is evaluated on three public datasets: Berkeley segmentation dataset, MSRC dataset and LHI dataset. Compared to five state-of-the-art approaches including Boycov et al., Bai et al., Grady, Unger et al. and Couprie et al., our system outperforms those established approaches in both accuracy and efficiency by a large margin and achieves state-of-the-art results.

Interactive Object Segmentation Using Kernel Density Estimation Based Graph Cuts

Unsupervised Salient Object Segmentation Based on Kernel Density Estimation and Two-Phase Graph Cut

Prop-cut: A Mesh Cutting Method Based on Tikhonov Regularization

An Improved Interactive Graph Cuts for Image Segmentation

Efficient Video Cutout by Paint Selection

Mesh Decomposition With Cross-Boundary Brushes

Interactive segmentation method with graph cut and SVMs

Human object segmentation using Gaussian mixture model and graph cuts

Object Segmentation Using Graph Cuts for the H.264 Compressed Video with Moving Background

Robust interactive image segmentation with automatic boundary refinement

CO3 for Ultra-Fast and Accurate Interactive Segmentation

Locally Biased Discriminative Clustering Method for Interactive Image Segmentation.

Research on Improved Image Segmentation Algorithm Based on GrabCut

Interactive Object Segmentation with Inside-Outside Guidance

E-GrabCut: an Economic Method of Iterative Video Object Extraction

Interactive image segmentation by maximal similarity based region merging

Interactive Graph Cut Colorization

Robust Interactive Image Segmentation Via Iterative Refinement.

Interactive visual object extraction based on belief propagation

SwipeCut: Interactive Segmentation with Diversified Seed Proposals

Biomedical Image Segmentation Via Constrained Graph Cuts and Pre-Segmentation