Abstract:High-level semantic knowledge in addition to low-level visual cues is essentially crucial for co-saliency detection. This article proposes a novel end-to-end deep learning approach for robust co-saliency detection by simultaneously learning high-level groupwise semantic representation as well as deep visual features of a given image group. The interimage interaction at the semantic level and the complementarity between the group semantics and visual features are exploited to boost the inferring capability of co-salient regions. Specifically, the proposed approach consists of a co-category learning branch and a co-saliency detection branch. While the former is proposed to learn a groupwise semantic vector using co-category association of an image group as supervision, the latter is to infer precise co-salient maps based on the ensemble of group-semantic knowledge and deep visual cues. The group-semantic vector is used to augment visual features at multiple scales and acts as a top-down semantic guidance for boosting the bottom-up inference of co-saliency. Moreover, we develop a pyramidal attention (PA) module that endows the network with the capability of concentrating on important image patches and suppressing distractions. The co-category learning and co-saliency detection branches are jointly optimized in a multitask learning manner, further improving the robustness of the approach. We construct a new large-scale co-saliency data set COCO-SEG to facilitate research of the co-saliency detection. Extensive experimental results on COCO-SEG and a widely used benchmark Cosal2015 have demonstrated the superiority of the proposed approach compared with state-of-the-art methods.

Co-Saliency Detection Via Unified Hierarchical Graph Neural Network with Geometric Attention.

Co-saliency Detection Based on Hierarchical Consistency.

Co-Saliency Detection With Co-Attention Fully Convolutional Network

Deep Group-wise Fully Convolutional Network for Co-saliency Detection with Graph Propagation.

An End-to-End Network for Co-Saliency Detection in One Single Image

Saliency Detection With a Three-Stage Hierarchical Network

Multi-scale Graph Fusion for Co-saliency Detection

Robust Deep Co-Saliency Detection With Group Semantic and Pyramid Attention

Detecting Robust Co-Saliency with Recurrent Co-Attention Neural Network.

Co-salient Object Detection Based on Deep Saliency Networks and Seed Propagation over an Integrated Graph

DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection

Co-saliency detection via inter and intra saliency propagation.

Self-supervised image co-saliency detection

A Unified Multiple Inducible Co-attentions and Edge Guidance Network for Co-saliency Detection

Co-saliency Detection Via Looking Deep and Wide

DeepACG: Co-Saliency Detection via Semantic-aware Contrast Gromov-Wasserstein Distance

Co-saliency Detection Via Similarity-Based Saliency Propagation

Co-saliency Detection via Sparse Reconstruction and Co-salient Object Discovery.

Co-Saliency Detection via a General Optimization Model and Adaptive Graph Learning

Salient Object Detection via High-to-Low Hierarchical Context Aggregation

Hierarchical U-shape Attention Network for Salient Object Detection.