Abstract:Weakly-supervised video anomaly detection is typically formulated as a multi-instance learning problem, assigning anomaly scores to each video snippet by learning to rank with only video-level labels. However, previous approaches that rely on snippet-level embeddings generated by task-agnostic feature extractors inevitably encounter challenges such as intra-bag similarities and frame-level entanglement. As a result, the model may exhibit significant performance degradation, particularly when the target is looming or receding. To address these issues, we present a novel weakly-supervised hierarchical position-scale awareness model that incorporates heterogeneous cross-scale correlation learning to improve detection performance. Specifically, in addition to snippet-level embedding, we employ an object detector (e.g., YOLOv5) for frame-level target detection and perform normal target clustering. By introducing a hierarchical ranking strategy, we gradually disentangle potential anomaly targets from the frame to the snippet level. Subsequently, we design a simple yet efficient position-scale awareness inference method that predicts the spatial positions and scales of looming and receding targets based on the abnormal targets with high confidence in adjacent snippets. Furthermore, we introduce heterogeneous cross-scale correlation learning to acquire the correlation between targets and snippet embeddings, enabling our model to increase attention to anomaly-related targets. Compared to previous approaches that generate only anomaly scores for each snippet, our method can locate anomalous targets, making it more suitable for practical applications. Without bells and whistles, evaluations on commonly-used VAD benchmarks: ShanghaiTech, UCSD-Ped2, Avenue, UCF-Crime and UBnormal datasets show that our method yields competitive and highly promising results compared with existing unsupervised, self-supervised, and weakly-supervised competitors. The code will be made publicly available.

Abnormal Event Detection with Self-guiding Multi-instance Ranking Framework

Abnormal Event Detection Based on Multi-scale Markov Random Field.

3D ResNet with Ranking Loss Function for Abnormal Activity Detection in Videos

Pose-oriented scene-adaptive matching for abnormal event detection

A Constrained Self-adaptive Sparse Combination Representation Method for Abnormal Event Detection.

Abnormal Event Detection in Surveillance Videos Based on Multi-Scale Feature and Channel-Wise Attention Mechanism

Multi-Scale Temporal Relations and Segmented Channel Attention for Video Anomaly Detection

Multi-Stream 3D Latent Feature Clustering for Abnormality Detection in Videos

Anomalies cannot materialize or vanish out of thin air: A hierarchical multiple instance learning with position-scale awareness for video anomaly detection

Generative Adversarial Networks for Abnormal Event Detection in Videos Based on Self-Attention Mechanism

Abnormal Events Detection Using Deep Networks for Video Surveillance.

Temporal-Aware Self-Supervised Learning for Unsupervised Video Anomaly Detection

Sparse Coding Guided Spatiotemporal Feature Learning for Abnormal Event Detection in Large Videos

A Video Anomaly Detection Method Based on Sequence Recognition

Abnormal Event Detection with Semi-Supervised Sparse Topic Model.

Enhancing Feature Representation for Anomaly Detection Via Local-and-Global Temporal Relations and a Multi-stage Memory.

Abnormal visual event detection based on multi‐instance learning and autoregressive integrated moving average model in edge‐based Smart City surveillance

Multi-Instance Dictionary Learning For Detecting Abnormal Events In Surveillance Videos

MTFL: Multi-Timescale Feature Learning for Weakly-Supervised Anomaly Detection in Surveillance Videos

A working human abnormal operation recognition approach based on the deep multi-instance sorting model

Abnormal Event Detection Using Deep Contrastive Learning for Intelligent Video Surveillance System