Abstract:Image co-segmentation is the problem of automatically discovering the common objects co-occurring in a set of relevant images and segmenting them as foreground simultaneously. Although a bunch of approaches have been proposed to address this problem, many of them still suffer from certain limitations, e.g., supervised feature learning and complex models, which hinder their capability in the real-world scenarios. To alleviate these limitations, we propose a novel coarse-to-fine co-segmentation (CFC) framework, which utilizes the coarse foreground and background proposals to learn a robust similarity measure of the features in an unsupervised way, and then devises a simple objective function based on the definition of image co-segmentation. Specifically, we first generate superpixels for all the images and extract their features. Instead of using existing distance metrics, we utilize object proposal methods to generate coarse foreground and background to learn a similarity measure of superpixels to construct a robust feature similarity graph. Then we design an intuitive objective function to learn a segmentation similarity graph which should be consistent with feature similarity graph and also be able to co-segment the superpixels in the images into either foreground and background. This objective function can be further reformulated as a graph learning problem with intra and inter rank constraints. Experiments on two commonly used image datasets (iCoseg and MSRC) demonstrate that CFC outperforms other state-of-the-art methods. Notably, this performance is achieved by using only HSV feature.

Segmentation with Selectively Propagated Constraints

Fast Constraint Propagation for Image Segmentation

Exhaustive and Efficient Constraint Propagation: A Semi-Supervised Learning Perspective and Its Applications

Exhaustive and Efficient Constraint Propagation: A Graph-Based Learning Approach and Its Applications

Multi-modal Constraint Propagation for Heterogeneous Image Clustering

Multi-Class Constrained Normalized Cut with Hard, Soft, Unary and Pairwise Priors and Its Applications to Object Segmentation

Interactive Object Segmentation Using Kernel Density Estimation Based Graph Cuts

Iterative Graph Cuts Segmentation with Local Constraints

Coarse-to-fine Image Co-segmentation with Intra and Inter Rank Constraints

Constraint Satisfaction Solution for Target Segmentation under Complex Background

Label-efficient Segmentation via Affinity Propagation

Two-Stage Relation Constraint for Semantic Segmentation of Point Clouds

Semantic Segmentation with Same Topic Constraints

Part Propagation For Local Part Segmentation

Constrained Directed Graph Clustering and Segmentation Propagation for Multiple Foregrounds Cosegmentation

Pairwise Constraint Propagation on Multi-View Data.

Multi-Constrained Optimization Method of Line Segment Extraction Based on Multi-Scale Image Space

Semantic Segmentation Using Multiple Graphs With Block-Diagonal Constraints

Multiclass Image Segmentation Based on Pixel and Segment Level

Symmetric Graph Regularized Constraint Propagation.

An Adaptive Affinity Graph with Subspace Pursuit for Natural Image Segmentation