Abstract:At present, many video salient object detection methods based on deep convolutional neural networks still suffer from coarse object edges, poor detection integrity and wrongly highlighted background, which may be attributed to the loss of high-frequency information and the inadequacy of global structure information. To solve these problems, we find a new way based on graph neural network learning methods in non-Euclidean space. Specifically, we propose a novel video salient object detection method based on spatiotemporal co-attention and global structural dependence. First, in order to learn high-quality salient spatial features, we design a bidirectional progressive salient object spatial feature extraction module (Bi-PSSFEM), which fuses multi-scale spatial information in a bidirectional and recursive manner to fully capture important salient spatial information. Second, we design a novel ConvLSTM module embedded with the co-attention mechanism (CoAConvLSTM), which improves the continuous consistency of salient objects in the spatiotemporal domain by considering the spatiotemporal correlation between adjacent video frames. Furthermore, in order to identify salient objects of different scales in dynamic visual scenes, we adopt our proposed CoAConvLSTMs with different dilated rates to form the ASPP-CoAConvLSTM in parallel, so as to capture spatiotemporal information of rich spatial receptive fields. Finally, a spatiotemporal graph convolution network (STGCN) is designed to fully mine the spatiotemporal context structure information in non-Euclidian space, so as to further improve the network modelâ€™s ability to obtain salient spatiotemporal clues. Experiments on four public benchmark datasets show that our proposed method is superior to the current mainstream video salient object detection methods based on deep convolutional neural networks.

Video Salient Object Detection via Contrastive Features and Attention Modules

Bidirectional Cross-Selective Attention Network for Video Salient Object Detection

A novel spatiotemporal attention enhanced discriminative network for video salient object detection

A Video Salient Object Detection Model Guided By Spatio-Temporal Prior

Local Attention Sequence Model for Video Object Detection

Video Salient Object Detection Via Spatiotemporal Co-Attention and Global Structural Dependence

Video Salient Object Detection Using Dual-Stream Spatiotemporal Attention

Attention Embedded Spatio-Temporal Network for Video Salient Object Detection

Motion Guided Attention for Video Salient Object Detection.

Salient Object Detection in Video Based on Dynamic Attention Center.

Contrast-Oriented Deep Neural Networks for Salient Object Detection

Video-based Salient Object Detection Via Spatio-Temporal Difference and Coherence

Detection of Salient Objects with Focused Attention Based on Spatial and Temporal Coherence

Video Salient Object Detection via Fully Convolutional Networks

Video Salient Object Detection Network with Bidirectional Memory and Spatiotemporal Constraints.

Eye Fixation Assisted Detection Of Video Salient Objects

Part-aware attention correctness for video salient object detection

Superpixel Level Incremental Visual Saliency Detection in Low Contrast Video

Salient object detection in image sequences via spatial-temporal cue

Integrating Object Proposal with Attention Networks for Video Saliency Detection.

Salient Object Detection by Spatiotemporal and Semantic Features in Real-Time Video Processing Systems.