Abstract:This paper identifies and addresses a serious design bias of existing salient object detection (SOD) datasets, which unrealistically assume that each image should contain at least one clear and uncluttered salient object. This design bias has led to a saturation in performance for state-of-the-art SOD models when evaluated on existing datasets. However, these models are still far from satisfactory when applied to real-world scenes. Based on our analyses, we propose a new high-quality dataset and update the previous saliency benchmark. Specifically, our dataset, called Salient Objects in Clutter~\textbf{(SOC)}, includes images with both salient and non-salient objects from several common object categories. In addition to object category annotations, each salient image is accompanied by attributes that reflect common challenges in common scenes, which can help provide deeper insight into the SOD problem. Further, with a given saliency encoder, e.g., the backbone network, existing saliency models are designed to achieve mapping from the training image set to the training ground-truth set. We, therefore, argue that improving the dataset can yield higher performance gains than focusing only on the decoder design. With this in mind, we investigate several dataset-enhancement strategies, including label smoothing to implicitly emphasize salient boundaries, random image augmentation to adapt saliency models to various scenarios, and self-supervised learning as a regularization strategy to learn from small datasets. Our extensive results demonstrate the effectiveness of these tricks. We also provide a comprehensive benchmark for SOD, which can be found in our repository: <a class="link-external link-https" href="https://github.com/DengPingFan/SODBenchmark" rel="external noopener nofollow">this https URL</a>.

Superpixel-wise contrast exploration for salient object detection

Supervised contrastive learning with multi-scale interaction and integrity learning for salient object detection

Salient Object Detection Based on Visual Perceptual Saturation and Two-Stream Hybrid Networks.

Co-salient Object Detection with Iterative Purification and Predictive Optimization

SPSN: Superpixel Prototype Sampling Network for RGB-D Salient Object Detection

Deep Contrast Learning for Salient Object Detection

Memory-aided Contrastive Consensus Learning for Co-salient Object Detection

Contrast-Oriented Deep Neural Networks for Salient Object Detection

Weakly Supervised RGB-D Salient Object Detection With Prediction Consistency Training and Active Scribble Boosting

Optimal contrast based saliency detection

SOD‐diffusion: Salient Object Detection via Diffusion‐Based Image Generators

Salient Objects in Clutter

RGB-D Salient Object Detection with Cross-Modality Modulation and Selection

300-FPS Salient Object Detection Via Minimum Directional Contrast.

Spatial Continuity and Nonequal Importance in Salient Object Detection With Image-Category Supervision

Category-Aware Saliency Enhance Learning Based on CLIP for Weakly Supervised Salient Object Detection

Contrast Prior and Fluid Pyramid Integration for RGBD Salient Object Detection

Multi-Color Space Network for Salient Object Detection

Joint Salient Object Detection and Camouflaged Object Detection via Uncertainty-aware Learning

Optimizing the F-measure for Threshold-free Salient Object Detection.

Co-saliency Detection with Intra-Group Two-Stage Group Semantics Propagation and Inter-Group Contrastive Learning