Abstract:Recent methods for object co-segmentation focus on discovering single co-occurring relation of candidate regions representing the foreground of multiple images. However, region extraction based only on low and middle level information often occupies a large area of background without the help of semantic context. In addition, seeking single matching solution very likely leads to discover local parts of common objects. To cope with these deficiencies, we present a new object co-segmentation framework, which takes advantages of semantic information and globally explores multiple co-occurring matching cliques based on an N-partite graph structure. To this end, we first propose to incorporate candidate generation with semantic context. Based on the regions extracted from semantic segmentation of each image, we design a merging mechanism to hierarchically generate candidates with high semantic responses. Second, all candidates are taken into consideration to globally formulate multiple maximum weighted matching cliques, which complement the discovery of part of the common objects induced by a single clique. To facilitate the discovery of multiple matching cliques, an N-partite graph, which inherently excludes intralinks between candidates from the same image, is constructed to separate multiple cliques without additional constraints. Further, we augment the graph with an additional virtual node in each part to handle irrelevant matches when the similarity between the two candidates is too small. Finally, with the explored multiple cliques, we statistically compute pixel-wise co-occurrence map for each image. Experimental results on two benchmark data sets, i.e., iCoseg and MSRC data sets achieve desirable performance and demonstrate the effectiveness of our proposed framework.

Constrained Directed Graph Clustering and Segmentation Propagation for Multiple Foregrounds Cosegmentation

Object Co-Segmentation Based on Directed Graph Clustering

Coarse-to-fine Image Co-segmentation with Intra and Inter Rank Constraints

Object cosegmentation by nonrigid mapping.

Object Cosegmentation by Similarity Propagation with Saliency Information and Objectness Frequency Map

Human object segmentation using Gaussian mixture model and graph cuts

Object Co-segmentation via Graph Optimized-Flexible Manifold Ranking

Automatic Segmentation of Foreground Objects from Multiple Images Based on Consistency Analysis

Image Cosegmentation via Saliency-Guided Constrained Clustering with Cosine Similarity

Multi-class Object Segmentation Based on Jointly Integrating Segment-Level and Image-Level Object Priors

Enhanced figure-ground classification with background prior propagation.

Multi-Class Constrained Normalized Cut with Hard, Soft, Unary and Pairwise Priors and Its Applications to Object Segmentation

Automatic Object Cosegmentation In Sparse Multiview Images

Multiple Semantic Matching on Augmented $N$ -Partite Graph for Object Co-Segmentation

Weak Supervision Learning for Object Co-Segmentation

Multi-View Graph Embedding Learning for Image Co-Segmentation and Co-Localization

Deep Markov Clustering for Panoptic Segmentation.

Foreground Segmentation Via Dynamic Programming

Unsupervised regions based segmentation using object discovery

Unsupervised Multiple Object Cosegmentation via Ensemble MIML Learning.

Random Geometric Prior Forest for Multiclass Object Segmentation