Abstract:Recent advances in deep convolution neural networks (CNNs) boost the development of video salient object detection (SOD), and many remarkable deep-CNNs video SOD models have been proposed. However, many existing deep-CNNs video SOD models still suffer from coarse boundaries of the salient object, which may be attributed to the loss of high-frequency information. The traditional graph-based video SOD models can preserve object boundaries well by conducting superpixels/supervoxels segmentation in advance, but they perform weaker in highlighting the whole object than the latest deep-CNNs models, limited by heuristic graph clustering algorithms. To tackle this problem, we find a new way to address this issue under the framework of graph convolution networks (GCNs), taking advantage of graph model and deep neural network. Specifically, a superpixel-level spatiotemporal graph is first constructed among multiple frame-pairs by exploiting the motion cues implied in the frame-pairs. Then the graph data is imported into the devised multi-stream attention-aware GCN, where a novel Edge-Gated graph convolution (GC) operation is proposed to boost the saliency information aggregation on the graph data. A novel attention module is designed to encode the spatiotemporal sematic information via adaptive selection of graph nodes and fusion of the static-specific and the motion-specific graph embedding. Finally, a smoothness-aware regularization term is proposed to enhance the uniformity of salient object. Graph nodes (superpixels) inherently belonging to the same class will be ideally clustered together in the learned embedding space. Extensive experiments have been conducted on three widely used datasets. Compared with fourteen state-of-the-art video SOD models, our proposed method can well retain the salient object boundaries and possess a strong learning ability, which shows that this work is a good practice for designing GCNs for video SOD.

A Moving Object Detection Method Based on Graph Neural Network

Graph CNN for Moving Object Detection in Complex Environments from Unseen Videos

MPNET: An End-to-End Deep Neural Network for Object Detection in Surveillance Video.

Moving Object Detection for Event-based vision using Graph Spectral Clustering

A GNN-Enhanced Game Bot Detection Model for MMORPGs

Neuromorphic Vision-based Motion Segmentation with Graph Transformer Neural Network

Event-based Object Detection Using Graph Neural Networks

An Event-Driven Object Recognition Model Using Activated Connected Domain Detection

Moving Object Detection Based on Incremental Learning Low Rank Representation and Spatial Constraint.

Moving Object Detection Based on Improved VIBE and Graph Cut Optimization

Robust Dual-Graph Regularized Moving Object Detection

LiDAR-based 3D Video Object Detection with Foreground Context Modeling and Spatiotemporal Graph Reasoning

Moving Object Attention Selection Using Optical Flow And Pulse Coupled Neural Network

Graph Networks for Multiple Object Tracking

General Moving Objects Recognition Method Based on Graph Embedding Dimension Reduction Algorithm

DCGNN: a single-stage 3D object detection network based on density clustering and graph neural network

CBi-GNN: Cross-Scale Bilateral Graph Neural Network for 3D Object Detection

Dynamic-Aware Network for Moving Object Detection

TGCN: Time Domain Graph Convolutional Network for Multiple Objects Tracking

Online Illumination Invariant Moving Object Detection by Generative Neural Network

Multi-Stream Attention-Aware Graph Convolution Network for Video Salient Object Detection