Abstract: Deep neural networks (DNNs) have become a key part of many modern software applications. After training and validating, the DNN is deployed as an irrevocable component and applied in real-world scenarios. Although most DNNs are built meticulously with huge volumes of training data, data in real-world still remain unknown to the DNN model, which leads to the crucial requirement of runtime out-of-distribution (OOD) detection. However, many existing approaches 1) need OOD data for classifier training or parameter tuning, or 2) simply combine the scores of each hidden layer as an ensemble of features for OOD detection. In this paper, we present a novel outlook on in-distribution data in a generative manner, which takes their latent features generated from each hidden layer as a joint distribution across representation spaces. Since only the in-distribution latent features are comprehensively understood in representation space, the internal difference between in-distribution and OOD data can be naturally revealed without the intervention of any OOD data. Specifically, We construct a generative model, called Latent Sequential Gaussian Mixture (LSGM), to depict how the in-distribution latent features are generated in terms of the trace of DNN inference across representation spaces. We first construct the Gaussian Mixture Model (GMM) based on in-distribution latent features for each hidden layer, and then connect GMMs via the transition probabilities of the inference traces. Experimental evaluations on popular benchmark OOD datasets and models validate the superiority of the proposed method over the state-of-the-art methods in OOD detection.

Out-of-distribution Detection with Diffusion-based Neighborhood

Diffusion Denoising Process for Perceptron Bias in Out-of-distribution Detection

Exploiting Diffusion Prior for Out-of-Distribution Detection

Beyond Perceptual Distances: Rethinking Disparity Assessment for Out-of-Distribution Detection with Diffusion Models

Out-of-Distribution Detection with a Single Unconditional Diffusion Model

Diffusion-based Layer-wise Semantic Reconstruction for Unsupervised Out-of-Distribution Detection

NODI: Out-Of-Distribution Detection with Noise from Diffusion

Towards In-Distribution Compatible Out-of-Distribution Detection.

Unsupervised Out-of-Distribution Detection with Diffusion Inpainting

Diffusion for Out-of-Distribution Detection on Road Scenes and Beyond

Joint Distribution across Representation Space for Out-of-Distribution Detection

OAL: Enhancing OOD Detection Using Latent Diffusion

Out-of-Distribution Detection with Deep Nearest Neighbors

GDDA: Semantic OOD Detection on Graphs under Covariate Shift via Score-Based Diffusion Models

Low-Dimensional Gradient Helps Out-of-Distribution Detection

Out-Of-Distribution Detection with Diversification (Provably)

Dual Conditioned Diffusion Models for Out-Of-Distribution Detection: Application to Fetal Ultrasound Videos

Mahalanobis-Aware Training for Out-of-Distribution Detection

Out-of-Distribution (OOD) Detection and Generalization Improved by Augmenting Adversarial Mixup Samples

Non-Linear Outlier Synthesis for Out-of-Distribution Detection