Abstract:Anomaly Detection (AD) in images is a fundamental computer vision problem and refers to identifying images and/or image substructures that deviate significantly from the norm. Popular AD algorithms commonly try to learn a model of normality from scratch using task specific datasets, but are limited to semi-supervised approaches employing mostly normal data due to the inaccessibility of anomalies on a large scale combined with the ambiguous nature of anomaly appearance. We follow an alternative approach and demonstrate that deep feature representations learned by discriminative models on large natural image datasets are well suited to describe normality and detect even subtle anomalies in a transfer learning setting. Our model of normality is established by fitting a multivariate Gaussian (MVG) to deep feature representations of classification networks trained on ImageNet using normal data only. By subsequently applying the Mahalanobis distance as the anomaly score we outperform the current state of the art on the public MVTec AD dataset, achieving an Area Under the Receiver Operating Characteristic curve of 95.8 ± 1.2% (mean ± SEM) over all 15 classes. We further investigate why the learned representations are discriminative to the AD task using Principal Component Analysis. We find that the principal components containing little variance in normal data are the ones crucial for discriminating between normal and anomalous instances. This gives a possible explanation to the often subpar performance of AD approaches trained from scratch using normal data only. By selectively fitting a MVG to these most relevant components only, we are able to further reduce model complexity while retaining AD performance. We also investigate setting the working point by selecting acceptable False Positive Rate thresholds based on the MVG assumption. Code is publicly available at https://github.com/ORippler/gaussian-ad-mvtec.

Latent Gaussian process for anomaly detection in categorical data

Anomaly Detection For Categorical Observations Using Latent Gaussian Process

Anomaly Detection in GPS Data Based on Visual Analytics

Generative Classification Model for Categorical Data Based on Latent Gaussian Process.

Variational Auto Encoder Fused with Gaussian Process for Unsupervised Anomaly Detection

Normalizing Flow-Based Probability Distribution Representation Detector for Hyperspectral Anomaly Detection.

Gaussian Anomaly Detection by Modeling the Distribution of Normal Data in Pretrained Deep Features

Exploring the Intrinsic Probability Distribution for Hyperspectral Anomaly Detection

Unsupervised Anomaly and Change Detection with Multivariate Gaussianization

NLP Based Anomaly Detection for Categorical Time Series

Restricted Generative Projection for One-Class Classification and Anomaly Detection

Multivariate Time Series Anomaly Detection with Few Positive Samples

Latent Anomaly Detection Through Density Matrices

Multivariate Categorical Data Distribution Estimation Based on Deep Gaussian Process

Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detection

Label-Free Multivariate Time Series Anomaly Detection

Gaussian Mixture Variational Autoencoder with Whitening Score for Multimodal Time Series Anomaly Detection

Anomaly Detection via Gumbel Noise Score Matching

Causality-Based Multivariate Time Series Anomaly Detection