Abstract:Recent advances in deep convolution neural networks (CNNs) boost the development of video salient object detection (SOD), and many remarkable deep-CNNs video SOD models have been proposed. However, many existing deep-CNNs video SOD models still suffer from coarse boundaries of the salient object, which may be attributed to the loss of high-frequency information. The traditional graph-based video SOD models can preserve object boundaries well by conducting superpixels/supervoxels segmentation in advance, but they perform weaker in highlighting the whole object than the latest deep-CNNs models, limited by heuristic graph clustering algorithms. To tackle this problem, we find a new way to address this issue under the framework of graph convolution networks (GCNs), taking advantage of graph model and deep neural network. Specifically, a superpixel-level spatiotemporal graph is first constructed among multiple frame-pairs by exploiting the motion cues implied in the frame-pairs. Then the graph data is imported into the devised multi-stream attention-aware GCN, where a novel Edge-Gated graph convolution (GC) operation is proposed to boost the saliency information aggregation on the graph data. A novel attention module is designed to encode the spatiotemporal sematic information via adaptive selection of graph nodes and fusion of the static-specific and the motion-specific graph embedding. Finally, a smoothness-aware regularization term is proposed to enhance the uniformity of salient object. Graph nodes (superpixels) inherently belonging to the same class will be ideally clustered together in the learned embedding space. Extensive experiments have been conducted on three widely used datasets. Compared with fourteen state-of-the-art video SOD models, our proposed method can well retain the salient object boundaries and possess a strong learning ability, which shows that this work is a good practice for designing GCNs for video SOD.

Graph Convolution And Self Attention Based Non-Maximum Suppression

D-NMS: A Dynamic NMS Network for General Object Detection.

Accelerating Non-Maximum Suppression: A Graph Theory Perspective

A Novel Non-maximum Suppression Algorithm Based on Affinity Propagation Clustering.

NMS-Loss: Learning with Non-Maximum Suppression for Crowded Pedestrian Detection

A line-segment-based non-maximum suppression method for accurate object detection

Inverted Non-maximum Suppression for more Accurate and Neater Face Detection

ASAP-NMS: Accelerating Non-Maximum Suppression Using Spatially Aware Priors

Improvement of Non-Maximum Suppression in RGB-D Object Detection

IdentifyNet for Non-Maximum Suppression

Joint-attention feature fusion network and dual-adaptive NMS for object detection

A review of non-maximum suppression algorithms for deep learning target detection

Detection Selection Algorithm: A Likelihood based Optimization Method to Perform Post Processing for Object Detection

Non-maximum Suppression Guided Label Assignment for Object Detection in Crowd Scenes

Adaptive Sparse Self-attention for Object Detection

Enhancing Object Detection in Dense Images: Adjustable Non-Maximum Suppression for Single-Class Detection

Confluence: A Robust Non-IoU Alternative to Non-Maxima Suppression in Object Detection

RESC: REfine the SCore with Adaptive Transformer Head for End-to-end Object Detection

Rethinking the Non-Maximum Suppression Step in 3D Object Detection from a Bird's-Eye View

Multi-Stream Attention-Aware Graph Convolution Network for Video Salient Object Detection

Object detection based on an adaptive attention mechanism