Abstract:As an interesting and emerging topic, co-saliency detection aims at simultaneously extracting common salient objects from a group of images. On one hand, traditional co-saliency detection approaches rely heavily on human knowledge for designing hand-crafted metrics to possibly reflect the faithful properties of the co-salient regions. Such strategies, however, always suffer from poor generalization capability to flexibly adapt various scenarios in real applications. On the other hand, most current methods pursue co-saliency detection in unsupervised fashions. This, however, tends to weaken their performance in real complex scenarios because they are lack of robust learning mechanism to make full use of the weak labels of each image. To alleviate these two problems, this paper proposes a new SP-MIL framework for co-saliency detection, which integrates both multiple instance learning (MIL) and self-paced learning (SPL) into a unified learning framework. Specifically, for the first problem, we formulate the co-saliency detection problem as a MIL paradigm to learn the discriminative classifiers to detect the co-saliency object in the "instance-level". The formulated MIL component facilitates our method capable of automatically producing the proper metrics to measure the intra-image contrast and the inter-image consistency for detecting co-saliency in a purely self-learning way. For the second problem, the embedded SPL paradigm is able to alleviate the data ambiguity under the weak supervision of co-saliency detection and guide a robust learning manner in complex scenarios. Experiments on benchmark datasets together with multiple extended computer vision applications demonstrate the superiority of the proposed framework beyond the state-of-the-arts.

A Saliency-Fusion-Based Framework for Co-localization.

Salient Object Detection with High-Level Prior Based on Bayesian Fusion.

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Hierarchical Saliency Mapping for Weakly Supervised Object Localization Based on Class Activation Mapping

A Robust Localization Approach Using Multi-Sensor Fusion

Co-saliency Detection via Sparse Reconstruction and Co-salient Object Discovery.

Fusing Saliency Maps with Region Proposals for Unsupervised Object Localization

Co-Saliency Detection Via Local Prediction and Global Refinement.

Co-Saliency Detection via a General Optimization Model and Adaptive Graph Learning

Co-Saliency Detection Within a Single Image

A New Method and Benchmark for Detecting Co-Saliency Within a Single Image

A Unified Metric Learning-Based Framework for Co-Saliency Detection.

Co-saliency Detection Based on Hierarchical Consistency.

Co-saliency Detection Via Looking Deep and Wide

A Feature-Adaptive Semi-Supervised Framework for Co-saliency Detection.

Multi-Camera Saliency.

Co-Saliency Detection Via a Self-Paced Multiple-Instance Learning Framework

Detection of Co-salient Objects by Looking Deep and Wide

Self-supervised image co-saliency detection

Modern Learning Methodologies for Co-Saliency Detection

An Object-Oriented Visual Saliency Detection Framework Based on Sparse Coding Representations