Abstract:Image co-segmentation is the problem of automatically discovering the common objects co-occurring in a set of relevant images and segmenting them as foreground simultaneously. Although a bunch of approaches have been proposed to address this problem, many of them still suffer from certain limitations, e.g., supervised feature learning and complex models, which hinder their capability in the real-world scenarios. To alleviate these limitations, we propose a novel coarse-to-fine co-segmentation (CFC) framework, which utilizes the coarse foreground and background proposals to learn a robust similarity measure of the features in an unsupervised way, and then devises a simple objective function based on the definition of image co-segmentation. Specifically, we first generate superpixels for all the images and extract their features. Instead of using existing distance metrics, we utilize object proposal methods to generate coarse foreground and background to learn a similarity measure of superpixels to construct a robust feature similarity graph. Then we design an intuitive objective function to learn a segmentation similarity graph which should be consistent with feature similarity graph and also be able to co-segment the superpixels in the images into either foreground and background. This objective function can be further reformulated as a graph learning problem with intra and inter rank constraints. Experiments on two commonly used image datasets (iCoseg and MSRC) demonstrate that CFC outperforms other state-of-the-art methods. Notably, this performance is achieved by using only HSV feature.

Image Cosegmentation via Cosaliency Guided and Spline Regression.

Image Cosegmentation via Saliency-Guided Constrained Clustering with Cosine Similarity

Image Cosegmentation Using Shape Similarity and Object Discovery Scheme

Image Cosegmentation by Incorporating Color Reward Strategy and Active Contour Model.

An Efficient Image Co-segmentation Algorithm Based on Active Contour and Image Saliency

Image Cosegmentation Based on Local and Global Level Set Methods.

Interactive Natural Image Segmentation Via Spline Regression

Object Cosegmentation by Similarity Propagation with Saliency Information and Objectness Frequency Map

Cosegmentation of Multiple Image Groups

Cosegmentation and Cosketch by Unsupervised Learning.

Image Co-Segmentation Via Saliency Co-Fusion

Mutual Learning Between Saliency and Similarity: Image Cosegmentation via Tree Structured Sparsity and Tree Graph Matching.

Cosegmentation from Similar Backgrounds

On Multiple Image Group Cosegmentation

Coarse-to-fine Image Co-segmentation with Intra and Inter Rank Constraints

Co-Segmentation of Multiple Similar Images Using Saliency Detection and Region Merging

Object cosegmentation by nonrigid mapping.

Local Spectral Method to Seeded Image Cosegmentation.

Image Co-segmentation Via Multi-scale Local Shape Transfer

Image Co-Segmentation Via Active Contours

Toward Stable Co-Saliency Detection and Object Co-Segmentation