Abstract:Existing CNN-based salient object detection (SOD) models rely heavily on large-scale pixel-level annotations, which are labor-intensive, time-consuming, and expensive. In contrast, sparse annotations (e.g., image-level or scribble) are gradually entering the SOD community. However, few efforts have been devoted to studying SOD from sparse annotations, especially in remote sensing. Moreover, sparse annotations usually contain a small amount of information, making it challenging to train a well-performing model, thereby causing its performance to lag largely behind fully-supervised models. Although some SOD methods adopt prior cues (e.g., edges) to improve performance, they usually lack targeted discrimination of object boundaries and thus provide saliency maps with poor boundary localization. To this end, in this paper, we propose a novel weakly-supervised SOD framework to predict the saliency of remote sensing images from sparse scribble annotations. To achieve it, we first construct the scribble-based remote sensing saliency dataset by relabeling an existing large-scale SOD dataset with scribbles, namely S-EOR dataset. After that, we present a novel scribble-based boundary-aware network (SBA-Net) for remote sensing saliency detection. Specifically, we design a boundary-aware module (BAM) to explore object boundary semantics, which is explicitly supervised by high-confidence object boundary (pseudo) labels generated by the boundary label generation (BLG) module, forcing the model to learn features that highlight object structures and thus boosting object boundary localization. Extensive quantitative and qualitative comparisons of two public remote sensing SOD datasets show that the proposed method outperforms current weakly supervised and unsupervised SOD methods and is highly competitive with existing fully supervised methods. Numerous ablation experiments demonstrate the effectiveness and generalization of the proposed model. The dataset and code will be publicly available at: https://github.com/ZhouHuang23/SBA-Net.

Benchmarking deep models on salient object detection

Benchmarking Deep Models for Salient Object Detection

Salient Objects in Clutter

Salient Objects in Clutter: Bringing Salient Object Detection to the Foreground

Salient Object Detection Based on Visual Perceptual Saturation and Two-Stream Hybrid Networks.

Salient Object Detection in the Deep Learning Era: An In-Depth Survey

Re-thinking Co-Salient Object Detection

Uncertainty-Aware Deep Calibrated Salient Object Detection

Self-Improved Learning for Salient Object Detection

UDNet: Uncertainty-aware Deep Network for Salient Object Detection

Progressive Self-Guided Loss for Salient Object Detection

Co-salient Object Detection with Iterative Purification and Predictive Optimization

Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks

Towards Large-Scale Small Object Detection: Survey and Benchmarks.

A Visual Representation-guided Framework with Global Affinity for Weakly Supervised Salient Object Detection

Scribble-based boundary-aware network for weakly supervised salient object detection in remote sensing images

Saliency Hierarchy Modeling via Generative Kernels for Salient Object Detection.

BiconNet: An Edge-preserved Connectivity-based Approach for Salient Object Detection

Size-invariance Matters: Rethinking Metrics and Losses for Imbalanced Multi-object Salient Object Detection

Collaborative Content-Dependent Modeling: A Return to the Roots of Salient Object Detection.