Abstract:This three‐level prediction, namely Progressive Prediction Video Anomaly Detection (P3VAD), enlarges the prediction error on irregular motion patterns. This is the first effort to progressively combine three‐level predictions from coarse to fine‐grained for VAD. We demonstrate the effectiveness of our framework by conducting an extensive experimental evaluation on the four publicly large‐scale benchmark datasets in both micro‐AUC and macro‐AUC metrics. Video Anomaly Detection (VAD) has been an active research field for several decades. However, most existing approaches merely extract a single type of feature from videos and define a single paradigm to indicate the extent of abnormalities. A coarse‐to‐fine three‐level prediction is built by integrating different levels of spatio‐temporal representations, better highlighting the difference between normal and abnormal behaviors. First, an object‐level trajectory prediction is proposed to model human historical position using a graph transformer network. Subsequently, skeleton‐level prediction is achieved by incorporating the positional information from the trajectory prediction. More importantly, based on the predicted skeleton, a skeleton‐guided pixel‐level region prediction is performed. A novel Skeleton Conditioned Generative Adversarial Network (SCGAN) is designed to explore the correlation between skeleton‐level and pixel‐level motion prediction. Benefiting from SCGAN, the prediction of human regions is contributed by both coarse‐grained and fine‐grained motion features. This three‐level prediction, namely Progressive Prediction Video Anomaly Detection (P3VAD), enlarges the prediction error on irregular motion patterns. Besides, a pixel‐level analysis method is proposed to achieve Background‐bias Elimination (BE) and denoise the predicted region. Experimental results validate the effectiveness of P3VAD on the four benchmark datasets (ShanghaiTech, CUHK Avenue, IITB‐Corridor, and ADOC).

Video Anomaly Detection Via Progressive Learning of Multiple Proxy Tasks

Progressive prediction: Video anomaly detection via multi‐grained prediction

Multi-Task Learning based Video Anomaly Detection with Attention

Future Video Prediction from a Single Frame for Video Anomaly Detection

Evaluating the Effectiveness of Video Anomaly Detection in the Wild: Online Learning and Inference for Real-world Deployment

Anomalies cannot materialize or vanish out of thin air: A hierarchical multiple instance learning with position-scale awareness for video anomaly detection

Open-Vocabulary Video Anomaly Detection

Multi-Scale Video Anomaly Detection by Multi-Grained Spatio-Temporal Representation Learning

Patch Spatio-Temporal Relation Prediction for Video Anomaly Detection

Learning Prompt-Enhanced Context Features for Weakly-Supervised Video Anomaly Detection

Long-Short Temporal Co-Teaching for Weakly Supervised Video Anomaly Detection

Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLM

Interleaving One-Class and Weakly-Supervised Models with Adaptive Thresholding for Unsupervised Video Anomaly Detection

Self-Training Multi-Sequence Learning with Transformer for Weakly Supervised Video Anomaly Detection

Configurable Spatial-Temporal Hierarchical Analysis for Flexible Video Anomaly Detection

Long-Short Temporal Co-Teaching for Weakly Supervised Video Anomaly Detection

Learn Suspected Anomalies from Event Prompts for Video Anomaly Detection

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Multi-Contextual Predictions with Vision Transformer for Video Anomaly Detection

Self Supervised Progressive Network for High Performance Video Object Segmentation

Dual contrast discriminator with sharing attention for video anomaly detection