Abstract:High-level semantic knowledge in addition to low-level visual cues is essentially crucial for co-saliency detection. This article proposes a novel end-to-end deep learning approach for robust co-saliency detection by simultaneously learning high-level groupwise semantic representation as well as deep visual features of a given image group. The interimage interaction at the semantic level and the complementarity between the group semantics and visual features are exploited to boost the inferring capability of co-salient regions. Specifically, the proposed approach consists of a co-category learning branch and a co-saliency detection branch. While the former is proposed to learn a groupwise semantic vector using co-category association of an image group as supervision, the latter is to infer precise co-salient maps based on the ensemble of group-semantic knowledge and deep visual cues. The group-semantic vector is used to augment visual features at multiple scales and acts as a top-down semantic guidance for boosting the bottom-up inference of co-saliency. Moreover, we develop a pyramidal attention (PA) module that endows the network with the capability of concentrating on important image patches and suppressing distractions. The co-category learning and co-saliency detection branches are jointly optimized in a multitask learning manner, further improving the robustness of the approach. We construct a new large-scale co-saliency data set COCO-SEG to facilitate research of the co-saliency detection. Extensive experimental results on COCO-SEG and a widely used benchmark Cosal2015 have demonstrated the superiority of the proposed approach compared with state-of-the-art methods.

Detection of Co-salient Objects by Looking Deep and Wide

Co-saliency Detection Via Looking Deep and Wide

Salient Object Detection with High-Level Prior Based on Bayesian Fusion.

Salient Object Detection Using Coarse-to-fine Processing.

Co-saliency Detection via Sparse Reconstruction and Co-salient Object Discovery.

Co-salient Object Detection Based on Deep Saliency Networks and Seed Propagation over an Integrated Graph

Co-saliency detection via inter and intra saliency propagation.

Two-Stage Co-Salient Object Detection

Co-saliency Detection Based on Hierarchical Consistency.

Deep Salient Object Detection by Integrating Multi-level Cues

Integrated Deep and Shallow Networks for Salient Object Detection

Robust Deep Co-Saliency Detection With Group Semantic and Pyramid Attention

Self-supervised image co-saliency detection

Salient Object Detection Using Window Mask Transferring With Multi-Layer Background Contrast

Semantical Knowledge Guided Salient Object Detection With Multiple Proposals

Detection of Salient Objects with Focused Attention Based on Spatial and Temporal Coherence

Group-wise deep co-saliency detection

DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection

Deep Learning Intra-Image and Inter-Images Features for Co-saliency Detection.

Coarse-to-fine Salient Object Detection Based on Deep Convolutional Neural Networks