Abstract:Anomaly detection (AD) has attracted considerable attention in both academia and industry. Due to the lack of anomalous data in many practical cases, AD is usually solved by first modeling the normal data pattern and then determining if data fit this model. Generative models (GMs) seem a natural tool to achieve this purpose, which learn the normal data distribution and estimate it using a probability density function (PDF). However, some works have observed the ideal performance of such GM-based AD methods. In this paper, we propose a new perspective on the ideal performance of GM-based AD methods. We state that in these methods, the implicit assumption that connects GMs'results to AD's goal is usually implausible due to normal data's multi-peaked distribution characteristic, which is quite common in practical cases. We first qualitatively formulate this perspective, and then focus on the Gaussian mixture model (GMM) to intuitively illustrate the perspective, which is a typical GM and has the natural property to approximate multi-peaked distributions. Based on the proposed perspective, in order to bypass the implicit assumption in the GMM-based AD method, we suggest integrating the Discriminative idea to orient GMM to AD tasks (DiGMM). With DiGMM, we establish a connection of generative and discriminative models, which are two key paradigms for AD and are usually treated separately before. This connection provides a possible direction for future works to jointly consider the two paradigms and incorporate their complementary characteristics for AD.

Further Analysis of Outlier Detection with Deep Generative Models.

A Method of Adaptive Hyperparameter Optimization for Deep Generative Models

Outlier Detection Using Generative Models with Theoretical Performance Guarantees

Understanding Deep Generative Models with Generalized Empirical Likelihoods

Generative Adversarial Active Learning for Unsupervised Outlier Detection

ODIM: Outlier Detection via Likelihood of Under-Fitted Generative Models

zGAN: An Outlier-focused Generative Adversarial Network For Realistic Synthetic Data Generation

DOI: Divergence-based Out-of-Distribution Indicators via Deep Generative Models

A Generative Adversarial Active Learning Method for Effective Outlier Detection

Generative adversarial nets for unsupervised outlier detection

Deep Generative Model Using Unregularized Score for Anomaly Detection With Heterogeneous Complexity

Analyzing the Training Processes of Deep Generative Models.

A Geometric Explanation of the Likelihood OOD Detection Paradox

Principled Knowledge Extrapolation with GANs.

Bias and Generalization in Deep Generative Models: An Empirical Study

A Review: Generative Adversarial Networks

Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connections

An Error Analysis of Generative Adversarial Networks for Learning Distributions

On the Connection of Generative Models and Discriminative Models for Anomaly Detection

Likelihood Assignment for Out-of-Distribution Inputs in Deep Generative Models is Sensitive to Prior Distribution Choice

Outlier Analysis for Gene Expression Data