Abstract:Weakly-supervised video anomaly detection is typically formulated as a multi-instance learning problem, assigning anomaly scores to each video snippet by learning to rank with only video-level labels. However, previous approaches that rely on snippet-level embeddings generated by task-agnostic feature extractors inevitably encounter challenges such as intra-bag similarities and frame-level entanglement. As a result, the model may exhibit significant performance degradation, particularly when the target is looming or receding. To address these issues, we present a novel weakly-supervised hierarchical position-scale awareness model that incorporates heterogeneous cross-scale correlation learning to improve detection performance. Specifically, in addition to snippet-level embedding, we employ an object detector (e.g., YOLOv5) for frame-level target detection and perform normal target clustering. By introducing a hierarchical ranking strategy, we gradually disentangle potential anomaly targets from the frame to the snippet level. Subsequently, we design a simple yet efficient position-scale awareness inference method that predicts the spatial positions and scales of looming and receding targets based on the abnormal targets with high confidence in adjacent snippets. Furthermore, we introduce heterogeneous cross-scale correlation learning to acquire the correlation between targets and snippet embeddings, enabling our model to increase attention to anomaly-related targets. Compared to previous approaches that generate only anomaly scores for each snippet, our method can locate anomalous targets, making it more suitable for practical applications. Without bells and whistles, evaluations on commonly-used VAD benchmarks: ShanghaiTech, UCSD-Ped2, Avenue, UCF-Crime and UBnormal datasets show that our method yields competitive and highly promising results compared with existing unsupervised, self-supervised, and weakly-supervised competitors. The code will be made publicly available.

stage one Observed Anomalies Unlabeled Instances Cluster Filter Potential Anomalies

Anomaly Detection with Partially Observed Anomalies

Learning Discrimination from Contaminated Data: Multi-Instance Learning for Unsupervised Anomaly Detection

AnomalyCD: A Benchmark for Earth Anomaly Change Detection with High-Resolution and Time-Series Observations

Meta pseudo labels for anomaly detection via partially observed anomalies

Robust Anomaly Detection from Partially Observed Anomalies with Augmented Classes

AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios

Exploring Global and Local Information for Anomaly Detection with Normal Samples

Isolation-Based Anomaly Detection

Towards a Unified Framework of Clustering-based Anomaly Detection

Label-Efficient Interactive Time-Series Anomaly Detection

Detecting Multivariate Time Series Anomalies with Zero Known Label

Weakly Supervised Anomaly Detection: A Survey

UNSUPERVISED ANOMALY DETECTION WITH SELF-TRAINING AND KNOWLEDGE DISTILLATION

Anomaly Heterogeneity Learning for Open-set Supervised Anomaly Detection

Weakly Supervised Anomaly Detection via Knowledge-Data Alignment

Research of Anomaly detection based on Dynamic Anomaly Detection Enhancement Framework

Clustering-based anomaly detection in multivariate time series data

Learning Discriminative Features for Semi-Supervised Anomaly Detection.

Anomalies cannot materialize or vanish out of thin air: A hierarchical multiple instance learning with position-scale awareness for video anomaly detection

Using Ensemble Classifiers to Detect Incipient Anomalies