Abstract:Anomaly Detection (AD) in images is a fundamental computer vision problem and refers to identifying images and/or image substructures that deviate significantly from the norm. Popular AD algorithms commonly try to learn a model of normality from scratch using task specific datasets, but are limited to semi-supervised approaches employing mostly normal data due to the inaccessibility of anomalies on a large scale combined with the ambiguous nature of anomaly appearance. We follow an alternative approach and demonstrate that deep feature representations learned by discriminative models on large natural image datasets are well suited to describe normality and detect even subtle anomalies in a transfer learning setting. Our model of normality is established by fitting a multivariate Gaussian (MVG) to deep feature representations of classification networks trained on ImageNet using normal data only. By subsequently applying the Mahalanobis distance as the anomaly score we outperform the current state of the art on the public MVTec AD dataset, achieving an Area Under the Receiver Operating Characteristic curve of 95.8 ± 1.2% (mean ± SEM) over all 15 classes. We further investigate why the learned representations are discriminative to the AD task using Principal Component Analysis. We find that the principal components containing little variance in normal data are the ones crucial for discriminating between normal and anomalous instances. This gives a possible explanation to the often subpar performance of AD approaches trained from scratch using normal data only. By selectively fitting a MVG to these most relevant components only, we are able to further reduce model complexity while retaining AD performance. We also investigate setting the working point by selecting acceptable False Positive Rate thresholds based on the MVG assumption. Code is publicly available at https://github.com/ORippler/gaussian-ad-mvtec.

Perfect Density Models Cannot Guarantee Anomaly Detection

Latent Anomaly Detection Through Density Matrices

Normalizing Flow-Based Probability Distribution Representation Detector for Hyperspectral Anomaly Detection.

Exploring the Intrinsic Probability Distribution for Hyperspectral Anomaly Detection

Anomaly Detection with Variance Stabilized Density Estimation

Do Deep Generative Models Know What They Don't Know?

High-dimensional and permutation invariant anomaly detection

Understanding Anomaly Detection with Deep Invertible Networks through Hierarchies of Distributions and Features

A Model of Anomaly Discovery

A likelihood approach to nonparametric estimation of a singular distribution using deep generative models

Unsupervised Anomaly Detection by Robust Density Estimation

On Diffusion Modeling for Anomaly Detection

No Free Lunch: The Hazards of Over-Expressive Representations in Anomaly Detection

Real time dense anomaly detection by learning on synthetic negative data

Anomaly detection based on weighted fuzzy-rough density

Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detection

Adaptive Density Estimation for Generative Models

Latent Factor Models for Density Estimation

Beyond Confidence: Reliable Models Should Also Consider Atypicality