Abstract:Most deep anomaly detection models are based on learning normality from datasets due to the difficulty of defining abnormality by its diverse and inconsistent nature. Therefore, it has been a common practice to learn normality under the assumption that anomalous data are absent in a training dataset, which we call normality assumption. However, in practice, the normality assumption is often violated due to the nature of real data distributions that includes anomalous tails, i.e., a contaminated dataset. Thereby, the gap between the assumption and actual training data affects detrimentally in learning of an anomaly detection model. In this work, we propose a learning framework to reduce this gap and achieve better normality representation. Our key idea is to identify sample-wise normality and utilize it as an importance weight, which is updated iteratively during the training. Our framework is designed to be model-agnostic and hyperparameter insensitive so that it applies to a wide range of existing methods without careful parameter tuning. We apply our framework to three different representative approaches of deep anomaly detection that are classified into one-class classification-, probabilistic model-, and reconstruction-based approaches. In addition, we address the importance of a termination condition for iterative methods and propose a termination criterion inspired by the anomaly detection objective. We validate that our framework improves the robustness of the anomaly detection models under different levels of contamination ratios on five anomaly detection benchmark datasets and two image datasets. On various contaminated datasets, our framework improves the performance of three representative anomaly detection methods, measured by area under the ROC curve.

Learning Discrimination from Contaminated Data: Multi-Instance Learning for Unsupervised Anomaly Detection

Hierarchical Semi-supervised Contrastive Learning for Contamination-Resistant Anomaly Detection

Pull & Push: Leveraging Differential Knowledge Distillation for Efficient Unsupervised Anomaly Detection and Localization

Learning Discriminative Features for Semi-Supervised Anomaly Detection.

Contamination-Resilient Anomaly Detection Via Adversarial Learning on Partially-Observed Normal and Anomalous Data

Reconstruction-based Multi-Normal Prototypes Learning for Weakly Supervised Anomaly Detection

Unilaterally Aggregated Contrastive Learning with Hierarchical Augmentation for Anomaly Detection

Learning Competitive and Discriminative Reconstructions for Anomaly Detection

A Diffusion-Based Framework for Multi-Class Anomaly Detection

A Generic Machine Learning Framework for Fully-Unsupervised Anomaly Detection with Contaminated Data

Classification-Based Self-Supervised Learning For Anomaly Detection

Focus Your Distribution: Coarse-to-Fine Non-Contrastive Learning for Anomaly Detection and Localization

Learning Causal Temporal Relation and Feature Discrimination for Anomaly Detection.

Weakly supervised anomaly detection with multi-level contextual modeling

UAC-AD: Unsupervised Adversarial Contrastive Learning for Anomaly Detection on Multi-modal Data in Microservice Systems

Learning Unified Reference Representation for Unsupervised Multi-class Anomaly Detection

Multilevel Saliency-Guided Self-Supervised Learning for Image Anomaly Detection

Semi-supervised Graph Anomaly Detection Via Multi-view Contrastive Learning

CNC: Cross-modal Normality Constraint for Unsupervised Multi-class Anomaly Detection

An Iterative Method for Unsupervised Robust Anomaly Detection Under Data Contamination

Adaptive Deviation Learning for Visual Anomaly Detection with Data Contamination