Abstract:High-level semantic knowledge in addition to low-level visual cues is essentially crucial for co-saliency detection. This article proposes a novel end-to-end deep learning approach for robust co-saliency detection by simultaneously learning high-level groupwise semantic representation as well as deep visual features of a given image group. The interimage interaction at the semantic level and the complementarity between the group semantics and visual features are exploited to boost the inferring capability of co-salient regions. Specifically, the proposed approach consists of a co-category learning branch and a co-saliency detection branch. While the former is proposed to learn a groupwise semantic vector using co-category association of an image group as supervision, the latter is to infer precise co-salient maps based on the ensemble of group-semantic knowledge and deep visual cues. The group-semantic vector is used to augment visual features at multiple scales and acts as a top-down semantic guidance for boosting the bottom-up inference of co-saliency. Moreover, we develop a pyramidal attention (PA) module that endows the network with the capability of concentrating on important image patches and suppressing distractions. The co-category learning and co-saliency detection branches are jointly optimized in a multitask learning manner, further improving the robustness of the approach. We construct a new large-scale co-saliency data set COCO-SEG to facilitate research of the co-saliency detection. Extensive experimental results on COCO-SEG and a widely used benchmark Cosal2015 have demonstrated the superiority of the proposed approach compared with state-of-the-art methods.

A Novel Co-Attention Computation Block for Deep Learning Based Image Co-Segmentation

Channel and spatial attention based deep object co-segmentation

Image Co-segmentation with Multi-Scale Dual-Cross Correlation Network

A Dense Siamese U-Net Trained with Edge Enhanced 3D IOU Loss for Image Co-segmentation

Semantic Aware Attention Based Deep Object Co-segmentation

Group-wise Deep Object Co-Segmentation with Co-Attention Recurrent Neural Network

Deep Object Co-segmentation via Spatial-Semantic Network Modulation

Image Co-Segmentation Via Saliency Co-Fusion

Semantic Image Segmentation with Improved Position Attention and Feature Fusion

See More, Know More: Unsupervised Video Object Segmentation with Co-Attention Siamese Networks

Scale Channel Attention Network for Image Segmentation

Automatic image co-segmentation: a survey

Feedback Attention-Augmented Bilateral Network for Amodal Instance Segmentation

Research on Image Semantic Segmentation Based on Hybrid Cascade Feature Fusion and Detailed Attention Mechanism

Zero-Shot Video Object Segmentation with Co-Attention Siamese Networks

Toward Stable Co-Saliency Detection and Object Co-Segmentation

An End-to-End Network for Co-Saliency Detection in One Single Image

Coupled Squeeze-And-Excitation Blocks Based Cnn For Image Compression

Bilateral Network with Residual U-blocks and Dual-Guided Attention for Real-time Semantic Segmentation

Robust Deep Co-Saliency Detection With Group Semantic and Pyramid Attention

Semantic Image Segmentation Based On Attentions To Intra Scales And Inner Channels