Abstract:Video anomaly detection is to automatically identify predefined anomalous contents (e.g. abnormal objects, behaviors and scenes) in videos. The performance of video anomaly detection can be effectively improved by making the model focus more on the anomalous objects in videos. However, such existing approaches usually rely on pre-trained models, which not only require additional auxiliary information but also face the challenge of anomaly diversity in the real world. In this paper, we propose a new video anomaly detection method based on spatio-temporal relationships among objects. Concretely, we use a fully convolutional encoder-decoder network with symmetric skip connections as the backbone network, which can effectively extract features from the object regions at different scales. In the encoding stage, an attention mechanism is used to enhance the model's understanding of the spatio-temporal relationships among various types of objects in the video. In the decoding stage, a dynamic pattern generator is designed to memorize the inter-object spatio-temporal relationships, which thus enhances the reconstructions of normal samples while making the reconstructions of abnormal samples more difficult. We conduct extensive experiments on three widely used video anomaly detection datasets CUHK Avenue , ShanghaiTech Campus and UCSD Ped2 , and the experimental results show that our proposed method can significantly improve the performance, and achieves state-of-the-art overall performance (considering both effectiveness and efficiency). In particular, our method achieves a state-of-the-art AUC of 98.4% on the UCSD Ped2 dataset that consists of various anomalies in real-world scenarios.

Spatial Temporal Balanced Generative Adversarial AutoEncoder for Anomaly Detection

Spatio-Temporal AutoEncoder for Video Anomaly Detection.

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Learning Appearance-motion Normality for Video Anomaly Detection.

Attention-based residual autoencoder for video anomaly detection

Residual spatiotemporal autoencoder for unsupervised video anomaly detection

Convolutional Transformer based Dual Discriminator Generative Adversarial Networks for Video Anomaly Detection

Memory Enhanced Spatial-Temporal Graph Convolutional Autoencoder for Human-Related Video Anomaly Detection.

Tam-Net: Temporal Enhanced Appearance-To-Motion Generative Network For Video Anomaly Detection

Spatiotemporal consistency-enhanced network for video anomaly detection

Appearance-Motion united Auto-Encoder Framework for Video Anomaly Detection

Video anomaly detection and localization via multivariate gaussian fully convolution adversarial autoencoder

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Generate anomalies from normal: a partial pseudo-anomaly augmented approach for video anomaly detection

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

Spatiotemporal Masked Autoencoder with Multi-Memory and Skip Connections for Video Anomaly Detection

Self-Supervised Attentive Generative Adversarial Networks for Video Anomaly Detection

Learning Attention Augmented Spatial-temporal Normality for Video Anomaly Detection

Video Anomaly Detection Based on Global–Local Convolutional Autoencoder

Synthetic Pseudo Anomalies for Unsupervised Video Anomaly Detection: A Simple yet Efficient Framework based on Masked Autoencoder

What goes around comes around: Cycle-Consistency-based Short-Term Motion Prediction for Anomaly Detection using Generative Adversarial Networks