Abstract:Video anomaly detection is to automatically identify predefined anomalous contents (e.g. abnormal objects, behaviors and scenes) in videos. The performance of video anomaly detection can be effectively improved by making the model focus more on the anomalous objects in videos. However, such existing approaches usually rely on pre-trained models, which not only require additional auxiliary information but also face the challenge of anomaly diversity in the real world. In this paper, we propose a new video anomaly detection method based on spatio-temporal relationships among objects. Concretely, we use a fully convolutional encoder-decoder network with symmetric skip connections as the backbone network, which can effectively extract features from the object regions at different scales. In the encoding stage, an attention mechanism is used to enhance the model's understanding of the spatio-temporal relationships among various types of objects in the video. In the decoding stage, a dynamic pattern generator is designed to memorize the inter-object spatio-temporal relationships, which thus enhances the reconstructions of normal samples while making the reconstructions of abnormal samples more difficult. We conduct extensive experiments on three widely used video anomaly detection datasets CUHK Avenue , ShanghaiTech Campus and UCSD Ped2 , and the experimental results show that our proposed method can significantly improve the performance, and achieves state-of-the-art overall performance (considering both effectiveness and efficiency). In particular, our method achieves a state-of-the-art AUC of 98.4% on the UCSD Ped2 dataset that consists of various anomalies in real-world scenarios.

Anomaly Detection Based on Spatio-Temporal Sparse Representation and Visual Attention Analysis.

Unsupervised fast anomaly detection in crowds.

Anomaly Detection Method Based on Temporal Spatial Information Enhancement

Anomaly detection using sparse reconstruction in crowded scenes

Learning Attention Augmented Spatial-temporal Normality for Video Anomaly Detection

Spatial-temporal Convolutional Neural Networks for Anomaly Detection and Localization in Crowded Scenes

Anomaly Detection In Crowded Scenes By Sl-Hof Descriptor And Foreground Classification

Saliency-Based Abnormal Event Detection in Crowded Scenes

Video Anomaly Detection Based on a Hierarchical Activity Discovery Within Spatio-Temporal Contexts.

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Detecting anomalies in crowded scenes via locality-constrained affine subspace coding.

Anomaly detection with spatio-temporal context using depth images

Anomaly Detection through Spatio-temporal Context Modeling in Crowded Scenes

Sparse Coding Based Motion Attention for Abnormal Event Detection

Anomaly Detection and Localization in Crowded Scenes by Motion-field Shape Description and Similarity-based Statistical Learning

Anomaly Detection and Localization in Crowded Scenes Using Short-Term Trajectories

Anomaly Detection Via Local Coordinate Factorization And Spatio-Temporal Pyramid

Anomaly3D: Video Anomaly Detection Based on 3D-Normality Clusters

Anomaly Detection in Crowded Scenes Using Motion Energy Model

Sparse representation for robust abnormality detection in crowded scenes

Video anomaly detection based on scene classification