Abstract:Recent methods for object co-segmentation focus on discovering single co-occurring relation of candidate regions representing the foreground of multiple images. However, region extraction based only on low and middle level information often occupies a large area of background without the help of semantic context. In addition, seeking single matching solution very likely leads to discover local parts of common objects. To cope with these deficiencies, we present a new object co-segmentation framework, which takes advantages of semantic information and globally explores multiple co-occurring matching cliques based on an N-partite graph structure. To this end, we first propose to incorporate candidate generation with semantic context. Based on the regions extracted from semantic segmentation of each image, we design a merging mechanism to hierarchically generate candidates with high semantic responses. Second, all candidates are taken into consideration to globally formulate multiple maximum weighted matching cliques, which complement the discovery of part of the common objects induced by a single clique. To facilitate the discovery of multiple matching cliques, an N-partite graph, which inherently excludes intralinks between candidates from the same image, is constructed to separate multiple cliques without additional constraints. Further, we augment the graph with an additional virtual node in each part to handle irrelevant matches when the similarity between the two candidates is too small. Finally, with the explored multiple cliques, we statistically compute pixel-wise co-occurrence map for each image. Experimental results on two benchmark data sets, i.e., iCoseg and MSRC data sets achieve desirable performance and demonstrate the effectiveness of our proposed framework.

Semantic Segmentation Using Multiple Graphs With Block-Diagonal Constraints

Semantic Image Segmentation Based on Spatial Context Relations

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Shift in Semantic Segmentation

An Adaptive Affinity Graph with Subspace Pursuit for Natural Image Segmentation

Affinity Fusion Graph-Based Framework for Natural Image Segmentation

Multi-View Graph Embedding Learning for Image Co-Segmentation and Co-Localization

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Multiple Semantic Matching on Augmented $N$ -Partite Graph for Object Co-Segmentation

Resolving Inconsistent Semantics in Multi-Dataset Image Segmentation

Dual Graph Convolutional Network for Semantic Segmentation.

Improving Semantic Segmentation via Dilated Affinity

Robust Subspace Segmentation with Block-Diagonal Prior

Unsupervised Multi-Class Co-Segmentation via Joint-Cut Over $L_{1}$ -Manifold Hyper-Graph of Discriminative Image Regions

Sparse Graph Connectivity for Image Segmentation

Automated Label Unification for Multi-Dataset Semantic Segmentation with GNNs

Towards Multi-Semantic Image Annotation with Graph Regularized Exclusive Group Lasso

Hybrid Dilated Convolution Network Using Attentive Kernels for Real-Time Semantic Segmentation

Spatial Pyramid Based Graph Reasoning for Semantic Segmentation

Learning Dual Multi-Scale Manifold Ranking for Semantic Segmentation of High-Resolution Images

Real-time Semantic Image Segmentation Via Spatial Sparsity.

Better Image Segmentation by Exploiting Dense Semantic Predictions