Abstract:Recent methods for object co-segmentation focus on discovering single co-occurring relation of candidate regions representing the foreground of multiple images. However, region extraction based only on low and middle level information often occupies a large area of background without the help of semantic context. In addition, seeking single matching solution very likely leads to discover local parts of common objects. To cope with these deficiencies, we present a new object co-segmentation framework, which takes advantages of semantic information and globally explores multiple co-occurring matching cliques based on an N-partite graph structure. To this end, we first propose to incorporate candidate generation with semantic context. Based on the regions extracted from semantic segmentation of each image, we design a merging mechanism to hierarchically generate candidates with high semantic responses. Second, all candidates are taken into consideration to globally formulate multiple maximum weighted matching cliques, which complement the discovery of part of the common objects induced by a single clique. To facilitate the discovery of multiple matching cliques, an N-partite graph, which inherently excludes intralinks between candidates from the same image, is constructed to separate multiple cliques without additional constraints. Further, we augment the graph with an additional virtual node in each part to handle irrelevant matches when the similarity between the two candidates is too small. Finally, with the explored multiple cliques, we statistically compute pixel-wise co-occurrence map for each image. Experimental results on two benchmark data sets, i.e., iCoseg and MSRC data sets achieve desirable performance and demonstrate the effectiveness of our proposed framework.

Co-recognition of Image Pairs by Data-Driven Monte Carlo Image Exploration

Effective Bayesian Inference by Data-Driven Markov Chain Monte Carlo for Object Recognition and Image Segmentation

Learning Co-segmentation by Segment Swapping for Retrieval and Discovery

Integrating Bottom-Up/Top-Down for Object Recognition by Data Driven Markov Chain Monte Carlo

Weak Supervision Learning for Object Co-Segmentation

Combining Local Descriptions With Geometric Constraints For 3-D Object Recognition In Multiple Statuses

Co-Occurring of Object Detection and Identification towards unlabeled object discovery

Cooperative Object Segmentation and Recognition Via Restricted Boltzmann Machine

Self-supervised co-salient object detection via feature correspondence at multiple scales

Multiple Semantic Matching on Augmented $N$ -Partite Graph for Object Co-Segmentation

Exploiting Feature Correspondence Constraints for Image Recognition

Deep-dense Conditional Random Fields for Object Co-segmentation.

Image segmentation by data-driven markov chain monte carlo

Pairwise Decomposition of Image Sequences for Active Multi-view Recognition

COCM: Co-Occurrence-Based Consistency Matching in Domain-Adaptive Segmentation

Recognizing Unseen Attribute-Object Pair with Generative Model.

Shape matching and object recognition using shape contexts

A Concurrent Multiscale Detector for End-to-End Image Matching

Confidence-driven Image Co-Matting.

Toward Stable Co-Saliency Detection and Object Co-Segmentation

MiC: Image-text Matching in Circles with cross-modal generative knowledge enhancement