Abstract:This three‐level prediction, namely Progressive Prediction Video Anomaly Detection (P3VAD), enlarges the prediction error on irregular motion patterns. This is the first effort to progressively combine three‐level predictions from coarse to fine‐grained for VAD. We demonstrate the effectiveness of our framework by conducting an extensive experimental evaluation on the four publicly large‐scale benchmark datasets in both micro‐AUC and macro‐AUC metrics. Video Anomaly Detection (VAD) has been an active research field for several decades. However, most existing approaches merely extract a single type of feature from videos and define a single paradigm to indicate the extent of abnormalities. A coarse‐to‐fine three‐level prediction is built by integrating different levels of spatio‐temporal representations, better highlighting the difference between normal and abnormal behaviors. First, an object‐level trajectory prediction is proposed to model human historical position using a graph transformer network. Subsequently, skeleton‐level prediction is achieved by incorporating the positional information from the trajectory prediction. More importantly, based on the predicted skeleton, a skeleton‐guided pixel‐level region prediction is performed. A novel Skeleton Conditioned Generative Adversarial Network (SCGAN) is designed to explore the correlation between skeleton‐level and pixel‐level motion prediction. Benefiting from SCGAN, the prediction of human regions is contributed by both coarse‐grained and fine‐grained motion features. This three‐level prediction, namely Progressive Prediction Video Anomaly Detection (P3VAD), enlarges the prediction error on irregular motion patterns. Besides, a pixel‐level analysis method is proposed to achieve Background‐bias Elimination (BE) and denoise the predicted region. Experimental results validate the effectiveness of P3VAD on the four benchmark datasets (ShanghaiTech, CUHK Avenue, IITB‐Corridor, and ADOC).

Video Anomaly Detection Based on Cross-Frame Prediction Mechanism and Spatio-Temporal Memory-Enhanced Pseudo-3D Encoder.

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Video Anomaly Detection Based on Global–Local Convolutional Autoencoder

Research on Video Anomaly Detection Based on Cascaded Memory-augmented Autoencoder

A Novel Unsupervised Video Anomaly Detection Framework Based on Optical Flow Reconstruction and Erased Frame Prediction

Spatiotemporal Masked Autoencoder with Multi-Memory and Skip Connections for Video Anomaly Detection

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Memory-Augmented Spatial-Temporal Consistency Network for Video Anomaly Detection.

Configurable Spatial-Temporal Hierarchical Analysis for Flexible Video Anomaly Detection

Long Short-Term Dynamic Prototype Alignment Learning for Video Anomaly Detection

Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach

Cognition Guided Video Anomaly Detection Framework for Surveillance Services

Appearance Blur-driven AutoEncoder and Motion-guided Memory Module for Video Anomaly Detection

Pedestrian Spatio-Temporal Information Fusion For Video Anomaly Detection

Progressive prediction: Video anomaly detection via multi‐grained prediction

Bidirectional skip-frame prediction for video anomaly detection with intra-domain disparity-driven attention

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

Robust Unsupervised Video Anomaly Detection by Multipath Frame Prediction

Robust Unsupervised Video Anomaly Detection by Multi-Path Frame Prediction

Patch Spatio-Temporal Relation Prediction for Video Anomaly Detection

Spatiotemporal consistency-enhanced network for video anomaly detection