Abstract:As an interesting and emerging topic, co-saliency detection aims at simultaneously extracting common salient objects from a group of images. On one hand, traditional co-saliency detection approaches rely heavily on human knowledge for designing hand-crafted metrics to possibly reflect the faithful properties of the co-salient regions. Such strategies, however, always suffer from poor generalization capability to flexibly adapt various scenarios in real applications. On the other hand, most current methods pursue co-saliency detection in unsupervised fashions. This, however, tends to weaken their performance in real complex scenarios because they are lack of robust learning mechanism to make full use of the weak labels of each image. To alleviate these two problems, this paper proposes a new SP-MIL framework for co-saliency detection, which integrates both multiple instance learning (MIL) and self-paced learning (SPL) into a unified learning framework. Specifically, for the first problem, we formulate the co-saliency detection problem as a MIL paradigm to learn the discriminative classifiers to detect the co-saliency object in the "instance-level". The formulated MIL component facilitates our method capable of automatically producing the proper metrics to measure the intra-image contrast and the inter-image consistency for detecting co-saliency in a purely self-learning way. For the second problem, the embedded SPL paradigm is able to alleviate the data ambiguity under the weak supervision of co-saliency detection and guide a robust learning manner in complex scenarios. Experiments on benchmark datasets together with multiple extended computer vision applications demonstrate the superiority of the proposed framework beyond the state-of-the-arts.

A New Co-Saliency Model Via Pairwise Constraint Graph Matching

Matching Images Based on Consistency Graph and Region Adjacency Graphs.

Saliency Detection Via Local Single Gaussian Model

Co-Saliency Detection via a General Optimization Model and Adaptive Graph Learning

Co-Saliency Detection Within a Single Image

A New Method and Benchmark for Detecting Co-Saliency Within a Single Image

Co-saliency Detection via Sparse Reconstruction and Co-salient Object Discovery.

A New Algorithm for Detecting Co-Saliency in Multiple Images through Sparse Coding Representation

Co-Saliency Detection Via Local Prediction and Global Refinement.

An End-to-End Network for Co-Saliency Detection in One Single Image

Co-saliency Detection Based on Hierarchical Consistency.

Co-saliency Detection Via Looking Deep and Wide

A Feature-Adaptive Semi-Supervised Framework for Co-saliency Detection.

Re-thinking The Relations in Co-saliency Detection

Self-supervised image co-saliency detection

Co-saliency Detection Based on Superpixel Matching and Cellular Automata.

Co-Saliency Detection Via a Self-Paced Multiple-Instance Learning Framework

CSA-Net: Deep Cross-Complementary Self Attention and Modality-Specific Preservation for Saliency Detection

Co-salient Object Detection Based on Deep Saliency Networks and Seed Propagation over an Integrated Graph

An Iterative Co-Saliency Framework for RGBD Images

Detection of Co-salient Objects by Looking Deep and Wide