Abstract:Weakly-supervised video anomaly detection is typically formulated as a multi-instance learning problem, assigning anomaly scores to each video snippet by learning to rank with only video-level labels. However, previous approaches that rely on snippet-level embeddings generated by task-agnostic feature extractors inevitably encounter challenges such as intra-bag similarities and frame-level entanglement. As a result, the model may exhibit significant performance degradation, particularly when the target is looming or receding. To address these issues, we present a novel weakly-supervised hierarchical position-scale awareness model that incorporates heterogeneous cross-scale correlation learning to improve detection performance. Specifically, in addition to snippet-level embedding, we employ an object detector (e.g., YOLOv5) for frame-level target detection and perform normal target clustering. By introducing a hierarchical ranking strategy, we gradually disentangle potential anomaly targets from the frame to the snippet level. Subsequently, we design a simple yet efficient position-scale awareness inference method that predicts the spatial positions and scales of looming and receding targets based on the abnormal targets with high confidence in adjacent snippets. Furthermore, we introduce heterogeneous cross-scale correlation learning to acquire the correlation between targets and snippet embeddings, enabling our model to increase attention to anomaly-related targets. Compared to previous approaches that generate only anomaly scores for each snippet, our method can locate anomalous targets, making it more suitable for practical applications. Without bells and whistles, evaluations on commonly-used VAD benchmarks: ShanghaiTech, UCSD-Ped2, Avenue, UCF-Crime and UBnormal datasets show that our method yields competitive and highly promising results compared with existing unsupervised, self-supervised, and weakly-supervised competitors. The code will be made publicly available.

Multi-Scale Memory Comparison for Zero-/Few-Shot Anomaly Detection

MBMF: Constructing Memory Banks of Multi‐scale Features for Anomaly Detection

DMMGNet: A Discrimination Mapping and Memory Bank Mean Guidance-based Network for High-performance Few-shot Industrial Anomaly Detection

Attention-based anomaly detection in multi-view surveillance videos

A Cognitive Memory-Augmented Network for Visual Anomaly Detection

AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios

From Unsupervised to Few-shot Graph Anomaly Detection: A Multi-scale Contrastive Learning Approach

A novel spatio-temporal memory network for video anomaly detection

Towards Zero-shot 3D Anomaly Localization

A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detection

A robust multi-scale feature extraction framework with dual memory module for multivariate time series anomaly detection

Anomalies cannot materialize or vanish out of thin air: A hierarchical multiple instance learning with position-scale awareness for video anomaly detection

Registration Based Few-Shot Anomaly Detection

DMAD: Dual Memory Bank for Real-World Anomaly Detection

Visual Anomaly Detection Via Partition Memory Bank Module and Error Estimation

AnomalySD: Few-Shot Multi-Class Anomaly Detection with Stable Diffusion Model

Semantic Coarse-to-Fine Granularity Learning for Two-Stage Few-Shot Anomaly Detection

Multi-Scale Video Anomaly Detection by Multi-Grained Spatio-Temporal Representation Learning

Memoryless Multimodal Anomaly Detection via Student–Teacher Network and Signed Distance Learning

Few-shot Online Anomaly Detection and Segmentation

Few-Shot Anomaly Detection via Category-Agnostic Registration Learning