Abstract:Compared with laborious pixel-wise dense labeling, it is much easier to label data by scribbles, which only costs 1$\sim$2 seconds to label one image. However, using scribble labels to learn salient object detection has not been explored. In this paper, we propose a weakly-supervised salient object detection model to learn saliency from such annotations. In doing so, we first relabel an existing large-scale salient object detection dataset with scribbles, namely S-DUTS dataset. Since object structure and detail information is not identified by scribbles, directly training with scribble labels will lead to saliency maps of poor boundary localization. To mitigate this problem, we propose an auxiliary edge detection task to localize object edges explicitly, and a gated structure-aware loss to place constraints on the scope of structure to be recovered. Moreover, we design a scribble boosting scheme to iteratively consolidate our scribble annotations, which are then employed as supervision to learn high-quality saliency maps. As existing saliency evaluation metrics neglect to measure structure alignment of the predictions, the saliency map ranking metric may not comply with human perception. We present a new metric, termed saliency structure measure, to measure the structure alignment of the predicted saliency maps, which is more consistent with human perception. Extensive experiments on six benchmark datasets demonstrate that our method not only outperforms existing weakly-supervised/unsupervised methods, but also is on par with several fully-supervised state-of-the-art models. Our code and data is publicly available at <a class="link-external link-https" href="https://github.com/JingZhang617/Scribble_Saliency" rel="external noopener nofollow">this https URL</a>.

Category-Aware Saliency Enhance Learning Based on CLIP for Weakly Supervised Salient Object Detection

Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection.

Supervised contrastive learning with multi-scale interaction and integrity learning for salient object detection

WUSL–SOD: Joint Weakly Supervised, Unsupervised and Supervised Learning for Salient Object Detection

Spatial Continuity and Nonequal Importance in Salient Object Detection With Image-Category Supervision

Saliency Guided Contrastive Learning on Scene Images

A novel seminar learning framework for weakly supervised salient object detection

Memory-aided Contrastive Consensus Learning for Co-salient Object Detection

Weakly Supervised RGB-D Salient Object Detection With Prediction Consistency Training and Active Scribble Boosting

Salient Object Detection Based on Visual Perceptual Saturation and Two-Stream Hybrid Networks.

RGB-D Salient Object Detection with Cross-Modality Modulation and Selection

Weakly supervised salient object detection via bounding-box annotation and SAM model

Self-Improved Learning for Salient Object Detection

A Visual Representation-guided Framework with Global Affinity for Weakly Supervised Salient Object Detection

Dynamic Selective Network for RGB-D Salient Object Detection

CLASS: Cross-Level Attention and Supervision for Salient Objects Detection

Activation to Saliency: Forming High-Quality Labels for Completely Unsupervised Salient Object Detection

Weakly-Supervised Salient Object Detection via Scribble Annotations

Complementary characteristics fusion network for weakly supervised salient object detection

Texture-guided Saliency Distilling for Unsupervised Salient Object Detection

Weakly Supervised Salient Object Detection Using Image Labels