Abstract:Existing CNN-based salient object detection (SOD) models rely heavily on large-scale pixel-level annotations, which are labor-intensive, time-consuming, and expensive. In contrast, sparse annotations (e.g., image-level or scribble) are gradually entering the SOD community. However, few efforts have been devoted to studying SOD from sparse annotations, especially in remote sensing. Moreover, sparse annotations usually contain a small amount of information, making it challenging to train a well-performing model, thereby causing its performance to lag largely behind fully-supervised models. Although some SOD methods adopt prior cues (e.g., edges) to improve performance, they usually lack targeted discrimination of object boundaries and thus provide saliency maps with poor boundary localization. To this end, in this paper, we propose a novel weakly-supervised SOD framework to predict the saliency of remote sensing images from sparse scribble annotations. To achieve it, we first construct the scribble-based remote sensing saliency dataset by relabeling an existing large-scale SOD dataset with scribbles, namely S-EOR dataset. After that, we present a novel scribble-based boundary-aware network (SBA-Net) for remote sensing saliency detection. Specifically, we design a boundary-aware module (BAM) to explore object boundary semantics, which is explicitly supervised by high-confidence object boundary (pseudo) labels generated by the boundary label generation (BLG) module, forcing the model to learn features that highlight object structures and thus boosting object boundary localization. Extensive quantitative and qualitative comparisons of two public remote sensing SOD datasets show that the proposed method outperforms current weakly supervised and unsupervised SOD methods and is highly competitive with existing fully supervised methods. Numerous ablation experiments demonstrate the effectiveness and generalization of the proposed model. The dataset and code will be publicly available at: https://github.com/ZhouHuang23/SBA-Net.

BASNet: Boundary-Aware Salient Object Detection

Boundary-Aware Segmentation Network for Mobile and Web Applications

Background-aware Siamese Network Tracking Based on Salient Feature Fusion

Real-time salient object detection with boundary information guidance

Boundary-semantic collaborative guidance network with dual-stream feedback mechanism for salient object detection in optical remote sensing imagery

A Salient Object Detection Method Based on Boundary Enhancement

Attention and boundary guided salient object detection

AWANet: Attentive-Aware Wide-Kernels Asymmetrical Network with Blended Contour Information for Salient Object Detection

BENet: boundary-enhanced network for real-time semantic segmentation

Graph-BAS3Net: Boundary-Aware Semi-Supervised Segmentation Network with Bilateral Graph Convolution

Scribble-based boundary-aware network for weakly supervised salient object detection in remote sensing images

Salient Object Detection Based on Visual Perceptual Saturation and Two-Stream Hybrid Networks.

Feature Perception and Refinement Network for Salient Object Detection

BiconNet: An Edge-preserved Connectivity-based Approach for Salient Object Detection

SAC-Net: Spatial Attenuation Context for Salient Object Detection

Bridging Feature Complementarity Gap Between Encoder and Decoder for Salient Object Detection

A Multistage Refinement Network for Salient Object Detection

R2Net: Residual refinement network for salient object detection

Bi-DAINet: Bi-Directional Discard-Accept-Integrate Network for salient object detection

Residual Refinement Network with Attribute Guidance for Precise Saliency Detection

DeepSaliency : MultiTask Deep Neural Network Model for Salient Object Detection