Abstract:Due to the advancement of deep learning, the performance of salient object detection (SOD) has been significantly improved. However, deep learning-based techniques require a sizable amount of pixel-wise annotations. To relieve the burden of data annotation, a variety of deep weakly-supervised and unsupervised SOD methods have been proposed, yet the performance gap between them and fully supervised methods remains significant. In this paper, we propose a novel, cost-efficient salient object detection framework, which can adapt models from synthetic data to real-world data with the help of a limited number of actively selected annotations. Specifically, we first construct a synthetic SOD dataset by copying and pasting foreground objects into pure background images. With the masks of foreground objects taken as the ground-truth saliency maps, this dataset can be used for training the SOD model initially. However, due to the large domain gap between synthetic images and real-world images, the performance of the initially trained model on the real-world images is deficient. To transfer the model from the synthetic dataset to the real-world datasets, we further design an uncertainty-aware active domain adaptive algorithm to generate labels for the real-world target images. The prediction variances against data augmentations are utilized to calculate the superpixel-level uncertainty values. For those superpixels with relatively low uncertainty, we directly generate pseudo labels according to the network predictions. Meanwhile, we select a few superpixels with high uncertainty scores and assign labels to them manually. This labeling strategy is capable of generating high-quality labels without incurring too much annotation cost. Experimental results on six benchmark SOD datasets demonstrate that our method outperforms the existing state-of-the-art weakly-supervised and unsupervised SOD methods and is even comparable to the fully supervised ones. Code will be released at: https://github.com/czh-3/UADA.

Semi-supervised Active Salient Object Detection.

Semi-supervised Salient Object Detection with Effective Confidence Estimation

Weakly Supervised Salient Object Detection Using Image Labels

Semi-Supervised Video Salient Object Detection Using Pseudo-Labels

Salient Object Detection Based on Visual Perceptual Saturation and Two-Stream Hybrid Networks.

Active learning with sampling by joint global-local uncertainty for salient object detection

Video Salient Object Detection via Fully Convolutional Networks

Salient Object Detection for RGB-D Images by Generative Adversarial Network.

Attention-guided salient object detection using autoencoder regularization

SuperVAE: Superpixelwise Variational Autoencoder for Salient Object Detection

Adversarial Learning Based Saliency Detection

Pixel is All You Need: Adversarial Spatio-Temporal Ensemble Active Learning for Salient Object Detection

Saliency Guided End-to-End Learning for Weakly Supervised Object Detection.

Activation to Saliency: Forming High-Quality Labels for Completely Unsupervised Salient Object Detection

Activation to Saliency: Forming High-Quality Labels for Unsupervised Salient Object Detection

Salient Object Detection with Image-level Binary Supervision

Salient Object Detection with Adversarial Training

Uncertainty-Aware Active Domain Adaptive Salient Object Detection

Self-explanatory Deep Salient Object Detection.

Exemplar-Aided Salient Object Detection Via Joint Latent Space Embedding

Saliency Guided End-to-end Learning Forweakly Supervised Object Detection