Abstract:Anomaly Detection (AD) in images is a fundamental computer vision problem and refers to identifying images and/or image substructures that deviate significantly from the norm. Popular AD algorithms commonly try to learn a model of normality from scratch using task specific datasets, but are limited to semi-supervised approaches employing mostly normal data due to the inaccessibility of anomalies on a large scale combined with the ambiguous nature of anomaly appearance. We follow an alternative approach and demonstrate that deep feature representations learned by discriminative models on large natural image datasets are well suited to describe normality and detect even subtle anomalies in a transfer learning setting. Our model of normality is established by fitting a multivariate Gaussian (MVG) to deep feature representations of classification networks trained on ImageNet using normal data only. By subsequently applying the Mahalanobis distance as the anomaly score we outperform the current state of the art on the public MVTec AD dataset, achieving an Area Under the Receiver Operating Characteristic curve of 95.8 ± 1.2% (mean ± SEM) over all 15 classes. We further investigate why the learned representations are discriminative to the AD task using Principal Component Analysis. We find that the principal components containing little variance in normal data are the ones crucial for discriminating between normal and anomalous instances. This gives a possible explanation to the often subpar performance of AD approaches trained from scratch using normal data only. By selectively fitting a MVG to these most relevant components only, we are able to further reduce model complexity while retaining AD performance. We also investigate setting the working point by selecting acceptable False Positive Rate thresholds based on the MVG assumption. Code is publicly available at https://github.com/ORippler/gaussian-ad-mvtec.

Understanding normalization in contrastive representation learning and out-of-distribution detection

Learning Discrimination from Contaminated Data: Multi-Instance Learning for Unsupervised Anomaly Detection

Exploring Simple, High Quality Out-of-Distribution Detection with L2 Normalization

Enhancing Out-of-distribution Detection Via Diversified Multi-Prototype Contrastive Learning

OOD Aware Supervised Contrastive Learning

CADet: Fully Self-Supervised Out-Of-Distribution Detection With Contrastive Learning

Representation Norm Amplification for Out-of-Distribution Detection in Long-Tail Learning

Focus Your Distribution: Coarse-to-Fine Non-Contrastive Learning for Anomaly Detection and Localization

OAL: Enhancing OOD Detection Using Latent Diffusion

Cluster-aware Contrastive Learning for Unsupervised Out-of-distribution Detection

Understanding the Feature Norm for Out-of-Distribution Detection

Density-driven Regularization for Out-of-distribution Detection

Envisioning Outlier Exposure by Large Language Models for Out-of-Distribution Detection

Positive Difference Distribution for Image Outlier Detection using Normalizing Flows and Contrastive Data

Class Relevance Learning For Out-of-distribution Detection

Continual Unsupervised Out-of-Distribution Detection

Unilaterally Aggregated Contrastive Learning with Hierarchical Augmentation for Anomaly Detection

Mahalanobis-Aware Training for Out-of-Distribution Detection

Visual Out-of-Distribution Detection in Open-Set Noisy Environments

Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detection