Abstract:Weakly-supervised video anomaly detection is typically formulated as a multi-instance learning problem, assigning anomaly scores to each video snippet by learning to rank with only video-level labels. However, previous approaches that rely on snippet-level embeddings generated by task-agnostic feature extractors inevitably encounter challenges such as intra-bag similarities and frame-level entanglement. As a result, the model may exhibit significant performance degradation, particularly when the target is looming or receding. To address these issues, we present a novel weakly-supervised hierarchical position-scale awareness model that incorporates heterogeneous cross-scale correlation learning to improve detection performance. Specifically, in addition to snippet-level embedding, we employ an object detector (e.g., YOLOv5) for frame-level target detection and perform normal target clustering. By introducing a hierarchical ranking strategy, we gradually disentangle potential anomaly targets from the frame to the snippet level. Subsequently, we design a simple yet efficient position-scale awareness inference method that predicts the spatial positions and scales of looming and receding targets based on the abnormal targets with high confidence in adjacent snippets. Furthermore, we introduce heterogeneous cross-scale correlation learning to acquire the correlation between targets and snippet embeddings, enabling our model to increase attention to anomaly-related targets. Compared to previous approaches that generate only anomaly scores for each snippet, our method can locate anomalous targets, making it more suitable for practical applications. Without bells and whistles, evaluations on commonly-used VAD benchmarks: ShanghaiTech, UCSD-Ped2, Avenue, UCF-Crime and UBnormal datasets show that our method yields competitive and highly promising results compared with existing unsupervised, self-supervised, and weakly-supervised competitors. The code will be made publicly available.

Anomaly Detection with Passive Aggressive Online Gaussian Model Estimation

Anomaly Candidate Identification and Starting Time Estimation of Vehicles from Traffic Videos.

Online Growing Neural Gas for Anomaly Detection in Changing Surveillance Scenes

Online Anomaly Detection with Sparse Gaussian Processes

Distributed Online One-Class Support Vector Machine for Anomaly Detection over Networks

Online Anomaly Detection over Live Social Video Streaming

Bounding Boxes and Probabilistic Graphical Models: Video Anomaly Detection Simplified

Video Anomaly Detection using GAN

AN EFFICIENT ANOMALY DETECTION APPROACH IN SURVEILLANCE VIDEO BASED ON ORIENTED GMM

Video Anomaly Detection Based on Attention Mechanism

Anomaly detection in online social networks

Video anomaly detection based on scene classification

Anomaly Detection and Localization in Crowded Scenes by Motion-field Shape Description and Similarity-based Statistical Learning

Evaluating the Effectiveness of Video Anomaly Detection in the Wild: Online Learning and Inference for Real-world Deployment

Real-time anomaly detection on surveillance video with two-stream spatio-temporal generative model

A Lightweight Video Anomaly Detection Model with Weak Supervision and Adaptive Instance Selection

An Adaptive Training-less System for Anomaly Detection in Crowd Scenes

Gaussian Anomaly Detection by Modeling the Distribution of Normal Data in Pretrained Deep Features

Anomalies cannot materialize or vanish out of thin air: A hierarchical multiple instance learning with position-scale awareness for video anomaly detection

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Online Anomaly Detection of Streaming Data for Space Payloads Based on Improved GNG Algorithm