Abstract:This three‐level prediction, namely Progressive Prediction Video Anomaly Detection (P3VAD), enlarges the prediction error on irregular motion patterns. This is the first effort to progressively combine three‐level predictions from coarse to fine‐grained for VAD. We demonstrate the effectiveness of our framework by conducting an extensive experimental evaluation on the four publicly large‐scale benchmark datasets in both micro‐AUC and macro‐AUC metrics. Video Anomaly Detection (VAD) has been an active research field for several decades. However, most existing approaches merely extract a single type of feature from videos and define a single paradigm to indicate the extent of abnormalities. A coarse‐to‐fine three‐level prediction is built by integrating different levels of spatio‐temporal representations, better highlighting the difference between normal and abnormal behaviors. First, an object‐level trajectory prediction is proposed to model human historical position using a graph transformer network. Subsequently, skeleton‐level prediction is achieved by incorporating the positional information from the trajectory prediction. More importantly, based on the predicted skeleton, a skeleton‐guided pixel‐level region prediction is performed. A novel Skeleton Conditioned Generative Adversarial Network (SCGAN) is designed to explore the correlation between skeleton‐level and pixel‐level motion prediction. Benefiting from SCGAN, the prediction of human regions is contributed by both coarse‐grained and fine‐grained motion features. This three‐level prediction, namely Progressive Prediction Video Anomaly Detection (P3VAD), enlarges the prediction error on irregular motion patterns. Besides, a pixel‐level analysis method is proposed to achieve Background‐bias Elimination (BE) and denoise the predicted region. Experimental results validate the effectiveness of P3VAD on the four benchmark datasets (ShanghaiTech, CUHK Avenue, IITB‐Corridor, and ADOC).

Scene-Dependent Prediction in Latent Space for Video Anomaly Detection and Anticipation

A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipation

Exploiting Spatial-temporal Correlations for Video Anomaly Detection

Memory-Augmented Spatial-Temporal Consistency Network for Video Anomaly Detection.

Boosting Variational Inference with Margin Learning for Few-Shot Scene-Adaptive Anomaly Detection.

Spatiotemporal consistency-enhanced network for video anomaly detection

Video Anomaly Detection Based on Cross-Frame Prediction Mechanism and Spatio-Temporal Memory-Enhanced Pseudo-3D Encoder.

Video Anomaly Prediction: Problem, Dataset and Method.

Patch Spatio-Temporal Relation Prediction for Video Anomaly Detection

Learning Prompt-Enhanced Context Features for Weakly-Supervised Video Anomaly Detection

Configurable Spatial-Temporal Hierarchical Analysis for Flexible Video Anomaly Detection

Multi-scale Spatial-temporal Interaction Network for Video Anomaly Detection

Feature Prediction Diffusion Model for Video Anomaly Detection

Adaptive Anomaly Detection Network for Unseen Scene Without Fine-Tuning

Video Anomaly Detection Via Predictive Autoencoder with Gradient-Based Attention

Enhanced Memory Adversarial Network for Anomaly Detection

Learn Suspected Anomalies from Event Prompts for Video Anomaly Detection

Temporal-Aware Self-Supervised Learning for Unsupervised Video Anomaly Detection

Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach

Spatio-Temporal Unity Networking for Video Anomaly Detection

Progressive prediction: Video anomaly detection via multi‐grained prediction