Abstract:Video anomaly detection presents a significant challenge in computer vision, with the aim of distinguishing various anomaly events from numerous normal ones. Weakly supervised video anomaly detection has recently emerged as a promising solution, enabling the detection of anomaly snippets with only video-level annotations. However, knowledge about anomaly annotation remains underutilized, resulting in a gap between visual space and semantic understanding of anomalies, thus failing to capture the clear boundary between anomalies and normalities. Therefore, we propose a weakly supervised paradigm of cross-modal detection and consistency learning, leveraging dual consistency to provide discriminative representations for anomalies at both the semantic-to-target and target-to-snippet levels. Specifically, we introduce a cross-modal detection network, which detects the targets in each frame according to given semantic rules, to derive semantic-consistent visual embeddings. To depict the clear boundary between anomalies and normalities, a cross-domain alignment module is proposed to enhance the discriminative representation of abnormal targets by learning the contextual consistency between the target and snippet embeddings. Our architecture integrates the detection of semantic-consistent targets based on variable semantic rules, ensuring transferable deployment across scenarios and enabling comprehensive identification, localization, and recognition of abnormal events through a “when-where-which” pipeline. The evaluation of our approach is conducted on four widely used public benchmarks: ShanghaiTech, UCSD Ped2, CUHK Avenue, and UBnormal through extensive qualitative and quantitative analyzes. The results demonstrate the remarkable performance of our approach in dealing with the VAD task.

Image Anomaly Detection with Semantic- Enhanced Augmentation and Distributional Kernel.

Self-Supervised Learning for Anomaly Detection With Dynamic Local Augmentation

Multilevel Saliency-Guided Self-Supervised Learning for Image Anomaly Detection

CutPaste: Self-Supervised Learning for Anomaly Detection and Localization

Self-Attention Memory-Augmented Wavelet-CNN for Anomaly Detection

Adjacent Image Augmentation and Its Framework for Self-Supervised Learning in Anomaly Detection

Self-supervised Augmented Patches Segmentation for Anomaly Detection.

Augment to Detect Anomalies with Continuous Labelling

Self-Supervised Learning for Industrial Image Anomaly Detection by Simulating Anomalous Samples

Semantic-driven Dual Consistency Learning for Weakly Supervised Video Anomaly Detection

Semantic Coarse-to-Fine Granularity Learning for Two-Stage Few-Shot Anomaly Detection

SaliencyCut: Augmenting Plausible Anomalies for Anomaly Detection

Efficient Anomaly Detection Using Self-Supervised Multi-Cue Tasks

Enhanced Reverse Distillation Guided Segmentation Network for Anomaly Detection

Learning Semantic Context from Normal Samples for Unsupervised Anomaly Detection

AnoSeg: Anomaly Segmentation Network Using Self-Supervised Learning

Anomaly Detection Using Local Kernel Density Estimation and Context-Based Regression.

Research of Anomaly detection based on Dynamic Anomaly Detection Enhancement Framework

Image Anomaly Detection Based on Controllable Self-Augmentation

Few-Shot Anomaly-Driven Generation for Anomaly Classification and Segmentation

Semi-supervised visual anomaly detection based on convolutional autoencoder and transfer learning