Abstract:Anomaly detection involves identifying instances within a dataset that deviate from the norm and occur infrequently. Current benchmarks tend to favor methods biased towards low diversity in normal data, which does not align with real-world scenarios. Despite advancements in these benchmarks, contemporary anomaly detection methods often struggle with out-of-distribution generalization, particularly in classifying samples with subtle transformations during testing. These methods typically assume that normal samples during test time have distributions very similar to those in the training set, while anomalies are distributed much further away. However, real-world test samples often exhibit various levels of distribution shift while maintaining semantic consistency. Therefore, effectively generalizing to samples that have undergone semantic-preserving transformations, while accurately detecting normal samples whose semantic meaning has changed after transformation as anomalies, is crucial for the trustworthiness and reliability of a model. For example, although it is clear that rotation shifts the meaning for a car in the context of anomaly detection but preserves the meaning for a bird, current methods are likely to detect both as abnormal. This complexity underscores the necessity for dynamic learning procedures rooted in the intrinsic concept of outliers. To address this issue, we propose new testing protocols and a novel method called Knowledge Exposure (KE), which integrates external knowledge to comprehend concept dynamics and differentiate transformations that induce semantic shifts. This approach enhances generalization by utilizing insights from a pre-trained CLIP model to evaluate the significance of anomalies for each concept. Evaluation on CIFAR-10, CIFAR-100, and SVHN with the new protocols demonstrates superior performance compared to previous methods.

Enhancing Anomaly Detection Generalization through Knowledge Exposure: The Dual Effects of Augmentation

Pull & Push: Leveraging Differential Knowledge Distillation for Efficient Unsupervised Anomaly Detection and Localization

Enhancing Anomaly Detection via Generating Diversified and Hard-to-distinguish Synthetic Anomalies

A Comprehensive Augmentation Framework for Anomaly Detection

Context-aware Feature Reconstruction for Class-Incremental Anomaly Detection and Localization

Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection

Augment to Detect Anomalies with Continuous Labelling

Research of Anomaly detection based on Dynamic Anomaly Detection Enhancement Framework

Image Anomaly Detection with Semantic- Enhanced Augmentation and Distributional Kernel.

Unsupervised anomaly detection and localization via bidirectional knowledge distillation

Multi-Channel Knowledge Distillation Via Efficient Feature Fusion Module for Anomaly Segmentation

Dual-Branch Knowledge Distillation Via Residual Features Aggregation Module for Anomaly Segmentation

Advancing Pre-trained Teacher: Towards Robust Feature Discrepancy for Anomaly Detection

SaliencyCut: Augmenting Plausible Anomalies for Anomaly Detection

Learning to Detect Interesting Anomalies

Anomaly Detection with Test Time Augmentation and Consistency Evaluation

Image Anomaly Detection Based on Controllable Self-Augmentation

Boosting Anomaly Detection Using Unsupervised Diverse Test-Time Augmentation

Enhanced multi-scale features mutual mapping fusion based on reverse knowledge distillation for industrial anomaly detection and localization

On The Relationship between Visual Anomaly-free and Anomalous Representations

Neural Transformation Learning for Deep Anomaly Detection Beyond Images