Abstract:Weakly supervised video anomaly detection (WS-VAD) aims to identify the snippets involving anomalous events in long untrimmed videos, with solely text video-level binary labels. A typical paradigm among the existing text WS-VAD methods is to employ multiple modalities as inputs, e.g., RGB, optical flow, and audio, as they can provide sufficient discriminative clues that are robust to the diverse, complicated real-world scenes. However, such a pipeline has high reliance on the availability of multiple modalities and is computationally expensive and storage demanding in processing long sequences, which limits its use in some applications. To address this dilemma, we propose a privileged knowledge distillation (KD) framework dedicated to the WS-VAD task, which can maintain the benefits of exploiting additional modalities, while avoiding the need for using multimodal data in the inference phase. We argue that the performance of the privileged KD framework mainly depends on two factors: 1) the effectiveness of the multimodal teacher network and 2) the completeness of the useful information transfer. To obtain a reliable teacher network, we propose a text cross-modal interactive learning strategy and an anomaly normal discrimination loss, which target learning task-specific cross-modal features and encourage the separability of anomalous and normal representations, respectively. Furthermore, we design both representation- and text logits-level distillation loss functions, which force the unimodal student network to distill abundant privileged knowledge from the text well-trained multimodal teacher network, in a snippet-to-video fashion. Extensive experimental results on three public benchmarks demonstrate that the proposed privileged KD framework can train a lightweight yet effective detector, for localizing anomaly events under the supervision of video-level annotations.

VDKD: A ViT-Based Student-Teacher Knowledge Distillation for Multi-Texture Class Anomaly Detection

Dual-student knowledge distillation for visual anomaly detection

Knowledge Distillation Method for Surface Defect Detection.

MixedTeacher : Knowledge Distillation for fast inference textural anomaly detection

Pull & Push: Leveraging Differential Knowledge Distillation for Efficient Unsupervised Anomaly Detection and Localization

Anomaly detection based on multi-teacher knowledge distillation

Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection

Anomaly Detection via Reverse Distillation from One-Class Embedding

Cosine similarity knowledge distillation for surface anomaly detection

RDMS: Reverse distillation with multiple students of different scales for anomaly detection

Dual-Student Knowledge Distillation Networks for Unsupervised Anomaly Detection

Structural Teacher-Student Normality Learning for Multi-Class Anomaly Detection and Localization

Unsupervised anomaly detection and localization via bidirectional knowledge distillation

Distilling Privileged Knowledge for Anomalous Event Detection From Weakly Labeled Videos

Dual-Modeling Decouple Distillation for Unsupervised Anomaly Detection

A Diffusion-Based Framework for Multi-Class Anomaly Detection

Advancing Pre-trained Teacher: Towards Robust Feature Discrepancy for Anomaly Detection

Enhanced multi-scale features mutual mapping fusion based on reverse knowledge distillation for industrial anomaly detection and localization

Autoencoder-Like Knowledge Distillation Network for Anomaly Detection

A Lightweight Pipeline Edge Detection Model Based on Heterogeneous Knowledge Distillation

ADPS: Asymmetric Distillation Post-Segmentation for Image Anomaly Detection