Abstract:Video anomaly detection is an essential yet challenging open-set task in computer vision, often addressed by leveraging reconstruction as a proxy task. However, existing reconstruction-based methods encounter challenges in two main aspects: (1) limited model robustness for open-set scenarios, (2) and an overemphasis on, but restricted capacity for, detailed motion reconstruction. To this end, we propose a novel frequency-guided diffusion model with perturbation training, which enhances the model robustness by perturbation training and emphasizes the principal motion components guided by motion frequencies. Specifically, we first use a trainable generator to produce perturbative samples for perturbation training of the diffusion model. During the perturbation training phase, the model robustness is enhanced and the domain of the reconstructed model is broadened by training against this generator. Subsequently, perturbative samples are introduced for inference, which impacts the reconstruction of normal and abnormal motions differentially, thereby enhancing their separability. Considering that motion details originate from high-frequency information, we propose a masking method based on 2D discrete cosine transform to separate high-frequency information and low-frequency information. Guided by the high-frequency information from observed motion, the diffusion model can focus on generating low-frequency information, and thus reconstructing the motion accurately. Experimental results on five video anomaly detection datasets, including human-related and open-set benchmarks, demonstrate the effectiveness of the proposed method. Our code is available at <a class="link-external link-https" href="https://github.com/Xiaofeng-Tan/FGDMAD-Code" rel="external noopener nofollow">this https URL</a>.

Video Anomaly Detection Via Motion Completion Diffusion for Intelligent Surveillance System

Dual Conditioned Motion Diffusion for Pose-Based Video Anomaly Detection

Multiscale Recovery Diffusion Model with Unsupervised Learning for Video Anomaly Detection System

VADiffusion: Compressed Domain Information Guided Conditional Diffusion for Video Anomaly Detection

Improved Anomaly Detection in Surveillance Videos with Multiple Probabilistic Models Inference

Unsupervised Video Anomaly Detection with Diffusion Models Conditioned on Compact Motion Representations

Anomaly detection based on hidden Markov model in videos

Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detection

Denoising Diffusion-Augmented Hybrid Video Anomaly Detection Via Reconstructing Noised Frames

Human-Machine Cooperative Video Anomaly Detection

A Video Abnormal Detection Framework Based on Appearance-Motion Fuse Memory

Ensemble anomaly score for video anomaly detection using denoise diffusion model and motion filters

Video anomaly detection and localization based on appearance and motion models

Feature Prediction Diffusion Model for Video Anomaly Detection

Safeguarding Sustainable Cities: Unsupervised Video Anomaly Detection Through Diffusion-based Latent Pattern Learning

Anomaly3D: Video Anomaly Detection Based on 3D-Normality Clusters

Anomaly detection in surveillance video using motion direction statistics

Pose-oriented scene-adaptive matching for abnormal event detection

Memory-enhanced appearance-motion consistency framework for video anomaly detection

Cognition Guided Video Anomaly Detection Framework for Surveillance Services

Video Anomaly Detection Using Diverse Motion-Conditioned Adversarial Predictive Network