Abstract:Weakly-supervised video anomaly detection is typically formulated as a multi-instance learning problem, assigning anomaly scores to each video snippet by learning to rank with only video-level labels. However, previous approaches that rely on snippet-level embeddings generated by task-agnostic feature extractors inevitably encounter challenges such as intra-bag similarities and frame-level entanglement. As a result, the model may exhibit significant performance degradation, particularly when the target is looming or receding. To address these issues, we present a novel weakly-supervised hierarchical position-scale awareness model that incorporates heterogeneous cross-scale correlation learning to improve detection performance. Specifically, in addition to snippet-level embedding, we employ an object detector (e.g., YOLOv5) for frame-level target detection and perform normal target clustering. By introducing a hierarchical ranking strategy, we gradually disentangle potential anomaly targets from the frame to the snippet level. Subsequently, we design a simple yet efficient position-scale awareness inference method that predicts the spatial positions and scales of looming and receding targets based on the abnormal targets with high confidence in adjacent snippets. Furthermore, we introduce heterogeneous cross-scale correlation learning to acquire the correlation between targets and snippet embeddings, enabling our model to increase attention to anomaly-related targets. Compared to previous approaches that generate only anomaly scores for each snippet, our method can locate anomalous targets, making it more suitable for practical applications. Without bells and whistles, evaluations on commonly-used VAD benchmarks: ShanghaiTech, UCSD-Ped2, Avenue, UCF-Crime and UBnormal datasets show that our method yields competitive and highly promising results compared with existing unsupervised, self-supervised, and weakly-supervised competitors. The code will be made publicly available.

A Sequential Monte Carlo Approach To Anomaly Detection In Tracking Visual Events

Visual Anomaly Detection in Event Sequence Data

Interpretable Anomaly Detection in Event Sequences Via Sequence Matching and Visual Comparison

Interactive Context-Aware Anomaly Detection Guided by User Feedback

Voila: Visual Anomaly Detection and Monitoring with Streaming Spatiotemporal Data

Multi-Scale One-Class Recurrent Neural Networks for Discrete Event Sequence Anomaly Detection

Sequential Event Detection Using Multimodal Data in Nonstationary Environments

Anomaly Detection Method Based on Temporal Spatial Information Enhancement

An anomaly-introduced learning method for abnormal event detection

A Video Anomaly Detection Method Based on Sequence Recognition

Anomaly detection based on hidden Markov model in videos

A novel statistical learning-based framework for automatic anomaly detection and localization in crowds

Unusual event detection in crowded scenes by trajectory analysis

Anomalies cannot materialize or vanish out of thin air: A hierarchical multiple instance learning with position-scale awareness for video anomaly detection

Abnormal Event Detection Based on Analysis of Movement Information of Video Sequence

Anomaly Detection Via Local Coordinate Factorization And Spatio-Temporal Pyramid

Anomaly Detection and Localization in Crowded Scenes by Motion-field Shape Description and Similarity-based Statistical Learning

Anomaly Detection and Localization in Crowded Scenes Using Short-Term Trajectories

Multiple Hypothesis Testing for Anomaly Detection in Multi-type Event Sequences

Learning Attention Augmented Spatial-temporal Normality for Video Anomaly Detection

Anomalous Situation Detection in Complex Scenes