Abstract:Deep learning models have been widely used for anomaly detection in surveillance videos. Typical models are equipped with the capability to reconstruct normal videos and evaluate the reconstruction errors on anomalous videos to indicate the extent of abnormalities. However, existing approaches suffer from two disadvantages. Firstly, they can only encode the movements of each identity independently, without considering the interactions among identities which may also indicate anomalies. Secondly, they leverage inflexible models whose structures are fixed under different scenes, this configuration disables the understanding of scenes. In this paper, we propose a Hierarchical Spatio-Temporal Graph Convolutional Neural Network (HSTGCNN) to address these problems, the HSTGCNN is composed of multiple branches that correspond to different levels of graph representations. High-level graph representations encode the trajectories of people and the interactions among multiple identities while low-level graph representations encode the local body postures of each person. Furthermore, we propose to weightedly combine multiple branches that are better at different scenes. An improvement over single-level graph representations is achieved in this way. An understanding of scenes is achieved and serves anomaly detection. High-level graph representations are assigned higher weights to encode moving speed and directions of people in low-resolution videos while low-level graph representations are assigned higher weights to encode human skeletons in high-resolution videos. Experimental results show that the proposed HSTGCNN significantly outperforms current state-of-the-art models on four benchmark datasets (UCSD Pedestrian, ShanghaiTech, CUHK Avenue and IITB-Corridor) by using much less learnable parameters.

Detecting video anomalies by jointly utilizing appearance and skeleton information

Video Anomaly Detection Using CycleGan Based on Skeleton Features

Human Kinematics-inspired Skeleton-based Video Anomaly Detection

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

A Self-Trained Spatial Graph Convolutional Network for Unsupervised Human-Related Anomalous Event Detection in Complex Scenes

A Dynamic Convolutional Generative Adversarial Network for Video Anomaly Detection

Multiscale Spatial Temporal Attention Graph Convolution Network for Skeleton-Based Anomaly Behavior Detection

Human-related Anomalous Event Detection Via Memory-Augmented Wasserstein Generative Adversarial Network with Gradient Penalty.

Mutuality-oriented Reconstruction and Prediction Hybrid Network for Video Anomaly Detection

Video Anomaly Detection with Multi-Scale Feature and Temporal Information Fusion

A Collaborative Framework Using Multimodal Data and Adaptive Noise for Human Behavior Anomaly Detection

Video Anomaly Detection Using Dual Discriminator Based Generative Adversarial Network.

Unsupervised Video Anomaly Detection by Learning Consistency of Appearance and Motion

3D U-Net for Video Anomaly Detection.

Memory Enhanced Spatial-Temporal Graph Convolutional Autoencoder for Human-Related Video Anomaly Detection.

Multi-Objective Optimized Generative Adversarial Networks for Video Anomaly Detection

Human-Machine Cooperative Video Anomaly Detection

A Hierarchical Spatio-Temporal Graph Convolutional Neural Network for Anomaly Detection in Videos

Multi-Channel Generative Framework and Supervised Learning for Anomaly Detection in Surveillance Videos

DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detection

Multimodal and multiscale feature fusion for weakly supervised video anomaly detection