Abstract:Weakly-supervised video anomaly detection is typically formulated as a multi-instance learning problem, assigning anomaly scores to each video snippet by learning to rank with only video-level labels. However, previous approaches that rely on snippet-level embeddings generated by task-agnostic feature extractors inevitably encounter challenges such as intra-bag similarities and frame-level entanglement. As a result, the model may exhibit significant performance degradation, particularly when the target is looming or receding. To address these issues, we present a novel weakly-supervised hierarchical position-scale awareness model that incorporates heterogeneous cross-scale correlation learning to improve detection performance. Specifically, in addition to snippet-level embedding, we employ an object detector (e.g., YOLOv5) for frame-level target detection and perform normal target clustering. By introducing a hierarchical ranking strategy, we gradually disentangle potential anomaly targets from the frame to the snippet level. Subsequently, we design a simple yet efficient position-scale awareness inference method that predicts the spatial positions and scales of looming and receding targets based on the abnormal targets with high confidence in adjacent snippets. Furthermore, we introduce heterogeneous cross-scale correlation learning to acquire the correlation between targets and snippet embeddings, enabling our model to increase attention to anomaly-related targets. Compared to previous approaches that generate only anomaly scores for each snippet, our method can locate anomalous targets, making it more suitable for practical applications. Without bells and whistles, evaluations on commonly-used VAD benchmarks: ShanghaiTech, UCSD-Ped2, Avenue, UCF-Crime and UBnormal datasets show that our method yields competitive and highly promising results compared with existing unsupervised, self-supervised, and weakly-supervised competitors. The code will be made publicly available.

Making Anomalies More Anomalous: Video Anomaly Detection Using a Novel Generator and Destroyer

Anomaly Detection in Traffic Surveillance Videos with GAN-based Future Frame Prediction

Generate anomalies from normal: a partial pseudo-anomaly augmented approach for video anomaly detection

TransGANomaly: Transformer based Generative Adversarial Network for Video Anomaly Detection

Convolutional Transformer based Dual Discriminator Generative Adversarial Networks for Video Anomaly Detection

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Video Anomaly Detection using GAN

Attention-guided generator with dual discriminator GAN for real-time video anomaly detection

Self-Supervised Attentive Generative Adversarial Networks for Video Anomaly Detection

Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach

Anomalies cannot materialize or vanish out of thin air: A hierarchical multiple instance learning with position-scale awareness for video anomaly detection

Learning Not to Reconstruct Anomalies

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Context-related video anomaly detection via generative adversarial network

Synthetic Temporal Anomaly Guided End-to-End Video Anomaly Detection

Multi-Channel Generative Framework and Supervised Learning for Anomaly Detection in Surveillance Videos

Enhancing Anomaly Detection via Generating Diversified and Hard-to-distinguish Synthetic Anomalies

Tam-Net: Temporal Enhanced Appearance-To-Motion Generative Network For Video Anomaly Detection

Video Anomaly Detection Based on Global–Local Convolutional Autoencoder

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

Synthetic Pseudo Anomalies for Unsupervised Video Anomaly Detection: A Simple yet Efficient Framework based on Masked Autoencoder