Abstract:As an interesting and emerging topic, co-saliency detection aims at simultaneously extracting common salient objects from a group of images. On one hand, traditional co-saliency detection approaches rely heavily on human knowledge for designing hand-crafted metrics to possibly reflect the faithful properties of the co-salient regions. Such strategies, however, always suffer from poor generalization capability to flexibly adapt various scenarios in real applications. On the other hand, most current methods pursue co-saliency detection in unsupervised fashions. This, however, tends to weaken their performance in real complex scenarios because they are lack of robust learning mechanism to make full use of the weak labels of each image. To alleviate these two problems, this paper proposes a new SP-MIL framework for co-saliency detection, which integrates both multiple instance learning (MIL) and self-paced learning (SPL) into a unified learning framework. Specifically, for the first problem, we formulate the co-saliency detection problem as a MIL paradigm to learn the discriminative classifiers to detect the co-saliency object in the "instance-level". The formulated MIL component facilitates our method capable of automatically producing the proper metrics to measure the intra-image contrast and the inter-image consistency for detecting co-saliency in a purely self-learning way. For the second problem, the embedded SPL paradigm is able to alleviate the data ambiguity under the weak supervision of co-saliency detection and guide a robust learning manner in complex scenarios. Experiments on benchmark datasets together with multiple extended computer vision applications demonstrate the superiority of the proposed framework beyond the state-of-the-arts.

Unsupervised Multiple Object Cosegmentation via Ensemble MIML Learning.

Saliency Based Multiple Object Cosegmentation by Ensemble MIML Learning

Attention Shift-Based Multiple Saliency Object Segmentation.

Object cosegmentation by nonrigid mapping.

A New Multiple Group Cosegmentation Model by Proposal Selection Strategy.

Unsupervised Multi-Class Co-Segmentation via Joint-Cut Over $L_{1}$ -Manifold Hyper-Graph of Discriminative Image Regions

Multiple Foreground Recognition and Cosegmentation: an Object-Oriented CRF Model with Robust Higher-Order Potentials

On Multiple Image Group Cosegmentation

Weak Supervision Learning for Object Co-Segmentation

Weakly Supervised Semantic Segmentation by Multiple Group Cosegmentation

Unsupervised Multiclass Region Cosegmentation Via Ensemble Clustering and Energy Minimization

Supervised Image Segmentation Using Learning And Merging\

CtxMIM: Context-Enhanced Masked Image Modeling for Remote Sensing Image Understanding

Unsupervised Co-segmentation of Complex Image Set via Bi-harmonic Distance Governed Multi-level Deformable Graph Clustering

Poselet-based multiple human identification and cosegmentation

Multiple Human Identification and Cosegmentation: A Human-Oriented CRF Approach with Poselets

Multi-class Object Segmentation Based on Jointly Integrating Segment-Level and Image-Level Object Priors

Boosted MIML method for weakly-supervised image semantic segmentation

Multi-Involution Memory Network for Unsupervised Video Object Segmentation

CML-MOTS: Collaborative Multi-task Learning for Multi-Object Tracking and Segmentation

Co-Saliency Detection Via a Self-Paced Multiple-Instance Learning Framework