Abstract:Recent advances in deep convolution neural networks (CNNs) boost the development of video salient object detection (SOD), and many remarkable deep-CNNs video SOD models have been proposed. However, many existing deep-CNNs video SOD models still suffer from coarse boundaries of the salient object, which may be attributed to the loss of high-frequency information. The traditional graph-based video SOD models can preserve object boundaries well by conducting superpixels/supervoxels segmentation in advance, but they perform weaker in highlighting the whole object than the latest deep-CNNs models, limited by heuristic graph clustering algorithms. To tackle this problem, we find a new way to address this issue under the framework of graph convolution networks (GCNs), taking advantage of graph model and deep neural network. Specifically, a superpixel-level spatiotemporal graph is first constructed among multiple frame-pairs by exploiting the motion cues implied in the frame-pairs. Then the graph data is imported into the devised multi-stream attention-aware GCN, where a novel Edge-Gated graph convolution (GC) operation is proposed to boost the saliency information aggregation on the graph data. A novel attention module is designed to encode the spatiotemporal sematic information via adaptive selection of graph nodes and fusion of the static-specific and the motion-specific graph embedding. Finally, a smoothness-aware regularization term is proposed to enhance the uniformity of salient object. Graph nodes (superpixels) inherently belonging to the same class will be ideally clustered together in the learned embedding space. Extensive experiments have been conducted on three widely used datasets. Compared with fourteen state-of-the-art video SOD models, our proposed method can well retain the salient object boundaries and possess a strong learning ability, which shows that this work is a good practice for designing GCNs for video SOD.

A Unified Multiple Inducible Co-attentions and Edge Guidance Network for Co-saliency Detection

Co-saliency Detection with Two-Stage Co-Attention Mining and Individual Calibration

CoGANet: Co-Guided Attention Network for Salient Object Detection

BCNet: Bidirectional Collaboration Network for Edge-Guided Salient Object Detection

Cross-modal and Cross-level Attention Interaction Network for Salient Object Detection

Motion Context Guided Edge-preserving Network for Video Salient Object Detection

CEMINet: Context exploration and multi-level interaction network for salient object detection

EGA-Net: Edge feature enhancement and global information attention network for RGB-D salient object detection

CoADNet: Collaborative Aggregation-and-Distribution Networks for Co-Salient Object Detection

An End-to-End Network for Co-Saliency Detection in One Single Image

EGNet:Edge Guidance Network for Salient Object Detection

Bi-attention Network for Bi-Directional Salient Object Detection

Multi-Stream Attention-Aware Graph Convolution Network for Video Salient Object Detection

Adaptive Group-wise Consistency Network for Co-saliency Detection

Co-Saliency Detection Via Unified Hierarchical Graph Neural Network with Geometric Attention.

Guidance and Teaching Network for Video Salient Object Detection

BiconNet: An Edge-preserved Connectivity-based Approach for Salient Object Detection

Co-saliency Detection with Intra-Group Two-Stage Group Semantics Propagation and Inter-Group Contrastive Learning

EMNet: Edge-guided multi-level network for salient object detection in low-light images

Adaptive Edge-Aware Semantic Interaction Network for Salient Object Detection in Optical Remote Sensing Images.

Salient Object Detection Based on Multiple Graph Neural Networks Collaborative Learning