Abstract:Video anomaly detection aims to find the events in a video that do not conform to the expected behavior. The prevalent methods mainly detect anomalies by snippet reconstruction or future frame prediction error. However, the error is highly dependent on the local context of the current snippet and lacks the understanding of normality. To address this issue, we propose to detect anomalous events not only by the local context, but also according to the consistency between the testing event and the knowledge about normality from the training data. Concretely, we propose a novel two-stream framework based on context recovery and knowledge retrieval, where the two streams can complement each other. For the context recovery stream, we propose a spatiotemporal U-Net which can fully utilize the motion information to predict the future frame. Furthermore, we propose a maximum local error mechanism to alleviate the problem of large recovery errors caused by complex foreground objects. For the knowledge retrieval stream, we propose an improved learnable locality-sensitive hashing, which optimizes hash functions via a Siamese network and a mutual difference loss. The knowledge about normality is encoded and stored in hash tables, and the distance between the testing event and the knowledge representation is used to reveal the probability of anomaly. Finally, we fuse the anomaly scores from the two streams to detect anomalies. Extensive experiments demonstrate the effectiveness and complementarity of the two streams, whereby the proposed two-stream framework achieves state-of-the-art performance on ShanghaiTech, Avenue and Corridor datasets among the methods without object detection. Even if compared with the methods using object detection, our method reaches competitive or better performance on the ShanghaiTech, Avenue, and Ped2 datasets.

Real-time anomaly detection on surveillance video with two-stream spatio-temporal generative model

Convolutional Transformer based Dual Discriminator Generative Adversarial Networks for Video Anomaly Detection

Anomaly Event Detection in Security Surveillance Using Two-Stream Based Model

Two‐stage video anomaly detection based on dual‐stream networks and multi‐instance learning

Multi-Channel Generative Framework and Supervised Learning for Anomaly Detection in Surveillance Videos

A Feature-Trajectory-Smoothed High-Speed Model for Video Anomaly Detection

Anomaly Detection in Traffic Surveillance Videos with GAN-based Future Frame Prediction

Configurable Spatial-Temporal Hierarchical Analysis for Flexible Video Anomaly Detection

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Online Anomaly Detection over Live Social Video Streaming

Real-Time Anomaly Detection in Video Streams

Spatiotemporal consistency-enhanced network for video anomaly detection

Deep learning based anomaly detection in real-time video

Multi-Scale Video Anomaly Detection by Multi-Grained Spatio-Temporal Representation Learning

An Efficient and Robust Unsupervised Anomaly Detection Method Using Ensemble Random Projection in Surveillance Videos

Tam-Net: Temporal Enhanced Appearance-To-Motion Generative Network For Video Anomaly Detection

Context Recovery and Knowledge Retrieval: A Novel Two-Stream Framework for Video Anomaly Detection

Learning Appearance-motion Normality for Video Anomaly Detection.

An unsupervised video anomaly detection method via Optical Flow decomposition and Spatio-Temporal feature learning

AI-Generated Video Detection via Spatio-Temporal Anomaly Learning

What goes around comes around: Cycle-Consistency-based Short-Term Motion Prediction for Anomaly Detection using Generative Adversarial Networks