Abstract:This three‐level prediction, namely Progressive Prediction Video Anomaly Detection (P3VAD), enlarges the prediction error on irregular motion patterns. This is the first effort to progressively combine three‐level predictions from coarse to fine‐grained for VAD. We demonstrate the effectiveness of our framework by conducting an extensive experimental evaluation on the four publicly large‐scale benchmark datasets in both micro‐AUC and macro‐AUC metrics. Video Anomaly Detection (VAD) has been an active research field for several decades. However, most existing approaches merely extract a single type of feature from videos and define a single paradigm to indicate the extent of abnormalities. A coarse‐to‐fine three‐level prediction is built by integrating different levels of spatio‐temporal representations, better highlighting the difference between normal and abnormal behaviors. First, an object‐level trajectory prediction is proposed to model human historical position using a graph transformer network. Subsequently, skeleton‐level prediction is achieved by incorporating the positional information from the trajectory prediction. More importantly, based on the predicted skeleton, a skeleton‐guided pixel‐level region prediction is performed. A novel Skeleton Conditioned Generative Adversarial Network (SCGAN) is designed to explore the correlation between skeleton‐level and pixel‐level motion prediction. Benefiting from SCGAN, the prediction of human regions is contributed by both coarse‐grained and fine‐grained motion features. This three‐level prediction, namely Progressive Prediction Video Anomaly Detection (P3VAD), enlarges the prediction error on irregular motion patterns. Besides, a pixel‐level analysis method is proposed to achieve Background‐bias Elimination (BE) and denoise the predicted region. Experimental results validate the effectiveness of P3VAD on the four benchmark datasets (ShanghaiTech, CUHK Avenue, IITB‐Corridor, and ADOC).

Robust Human Motion Estimation Using Bidirectional Motion Prior Model and Spatiotemporal Progressive Motion Optimization.

Temporal Constrained Feasible Subspace Learning for Human Pose Forecasting

Exploring Versatile Prior for Human Motion via Motion Frequency Guidance

TPGP: Temporal-Parametric Optimization with Deep Grasp Prior for Dexterous Motion Planning

PriorMotion: Generative Class-Agnostic Motion Prediction with Raster-Vector Motion Field Priors

Learning Variational Motion Prior for Video-based Motion Capture

Decomposed Human Motion Prior for Video Pose Estimation via Adversarial Training

ReMP: Reusable Motion Prior for Multi-domain 3D Human Pose Estimation and Motion Inbetweening

Robust Camera Motion Estimation in Video Sequences

HuMoR: 3D Human Motion Model for Robust Pose Estimation

Motion-DVAE: Unsupervised learning for fast human motion denoising

Task-Generic Hierarchical Human Motion Prior using VAEs

Adaptive Hierarchical Motion-Focused Model for Video Prediction.

Robust and Efficient Visual-Inertial Odometry with Multi-plane Priors.

PACE: Human and Camera Motion Estimation from in-the-wild Videos

3D Human Motion Estimation via Motion Compression and Refinement

Model-based portrait video compression with spatial constraint and adaptive pose processing

MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifolds

Progressive prediction: Video anomaly detection via multi‐grained prediction

MBRVO: A Blur Robust Visual Odometry Based on Motion Blurred Artifact Prior

Past Movements-Guided Motion Representation Learning for Human Motion Prediction