Abstract:Deep learning models have been widely used for anomaly detection in surveillance videos. Typical models are equipped with the capability to reconstruct normal videos and evaluate the reconstruction errors on anomalous videos to indicate the extent of abnormalities. However, existing approaches suffer from two disadvantages. Firstly, they can only encode the movements of each identity independently, without considering the interactions among identities which may also indicate anomalies. Secondly, they leverage inflexible models whose structures are fixed under different scenes, this configuration disables the understanding of scenes. In this paper, we propose a Hierarchical Spatio-Temporal Graph Convolutional Neural Network (HSTGCNN) to address these problems, the HSTGCNN is composed of multiple branches that correspond to different levels of graph representations. High-level graph representations encode the trajectories of people and the interactions among multiple identities while low-level graph representations encode the local body postures of each person. Furthermore, we propose to weightedly combine multiple branches that are better at different scenes. An improvement over single-level graph representations is achieved in this way. An understanding of scenes is achieved and serves anomaly detection. High-level graph representations are assigned higher weights to encode moving speed and directions of people in low-resolution videos while low-level graph representations are assigned higher weights to encode human skeletons in high-resolution videos. Experimental results show that the proposed HSTGCNN significantly outperforms current state-of-the-art models on four benchmark datasets (UCSD Pedestrian, ShanghaiTech, CUHK Avenue and IITB-Corridor) by using much less learnable parameters.

Spatial-temporal Convolutional Neural Networks for Anomaly Detection and Localization in Crowded Scenes

Deep-Anomaly: Fully Convolutional Neural Network for Fast Anomaly Detection in Crowded Scenes

An Efficient Anomaly Detection System For Crowded Scenes Using Variational Autoencoders

Anomaly Detection and Localization in Crowded Scenes by Motion-field Shape Description and Similarity-based Statistical Learning

Anomaly Detection and Localization in Crowded Scenes Using Short-Term Trajectories

Generative Neural Networks for Anomaly Detection in Crowded Scenes.

A novel statistical learning-based framework for automatic anomaly detection and localization in crowds

Anomaly Detection In Crowded Scenes By Sl-Hof Descriptor And Foreground Classification

Unsupervised fast anomaly detection in crowds.

Anomaly Detection through Spatio-temporal Context Modeling in Crowded Scenes

Video anomaly detection based on scene classification

Anomaly Detection Based on Spatio-Temporal Sparse Representation and Visual Attention Analysis.

A Hierarchical Spatio-Temporal Graph Convolutional Neural Network for Anomaly Detection in Videos

Anomaly Detection for Videos of Crowded Scenes Based on Optical Flow Information

Context-aware Local Abnormality Detection in Crowded Scene

Abnormal Event Detection and Location for Dense Crowds using Repulsive Forces and Sparse Reconstruction

Object and Patch Based Anomaly Detection and Localization in Crowded Scenes

An Abnormal Behavior Detection Method of Video Crowds and Vehicles Based on Deep Learning

Detecting anomaly based on time dependence for large scenes

Anomaly detection using sparse reconstruction in crowded scenes

Real-time and Accurate Abnormal Behavior Detection in Videos