Abstract:Video anomaly detection is to automatically identify predefined anomalous contents (e.g. abnormal objects, behaviors and scenes) in videos. The performance of video anomaly detection can be effectively improved by making the model focus more on the anomalous objects in videos. However, such existing approaches usually rely on pre-trained models, which not only require additional auxiliary information but also face the challenge of anomaly diversity in the real world. In this paper, we propose a new video anomaly detection method based on spatio-temporal relationships among objects. Concretely, we use a fully convolutional encoder-decoder network with symmetric skip connections as the backbone network, which can effectively extract features from the object regions at different scales. In the encoding stage, an attention mechanism is used to enhance the model's understanding of the spatio-temporal relationships among various types of objects in the video. In the decoding stage, a dynamic pattern generator is designed to memorize the inter-object spatio-temporal relationships, which thus enhances the reconstructions of normal samples while making the reconstructions of abnormal samples more difficult. We conduct extensive experiments on three widely used video anomaly detection datasets CUHK Avenue , ShanghaiTech Campus and UCSD Ped2 , and the experimental results show that our proposed method can significantly improve the performance, and achieves state-of-the-art overall performance (considering both effectiveness and efficiency). In particular, our method achieves a state-of-the-art AUC of 98.4% on the UCSD Ped2 dataset that consists of various anomalies in real-world scenarios.

Abnormal Object Representation Based on Surprise Model

The Detection of Unusual Events in Video Based on Bayesian Surprise Model

Video abnormal event detection based on fast sparse coding and surprise computation

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Local Attention Sequence Model for Video Object Detection

Learning Attention Augmented Spatial-temporal Normality for Video Anomaly Detection

Abnormal Behavior Detection Based on Regional Optical Flow

Object-Guided and Motion-Refined Attention Network for Video Anomaly Detection

Object-Oriented Anomaly Detection In Surveillance Videos

An Object-Aware Anomaly Detection and Localization in Surveillance Videos.

Statistical Model-based Abnormal Behavior Detection

Measuring Visual Surprise Jointly from Intrinsic and Extrinsic Contexts for Image Saliency Estimation

Object-based video anomaly detection using multi-attention and adaptive velocity attribute representation learning

Anomaly Detection Via Midlevel Visual Attributes

Video Saliency Detection via Dynamic Consistent Spatio-Temporal Attention Modelling.

Predictive Video Saliency Detection.

Learning Task-Specific Representation for Video Anomaly Detection with Spatial-Temporal Attention

Real-world Video Anomaly Detection by Extracting Salient Features in Videos

Video anomaly detection and localization based on appearance and motion models

Recognition of Unsafe Behavior of Electrical Workers based on Spatial-Temporal Visual Attention

Spatio-temporal Video Parsing for Abnormality Detection