Abstract:Out-of-distribution (OOD) detection is a crucial part of deploying machine learning models safely. It has been extensively studied with a plethora of methods developed in the literature. This problem is tackled with an OOD score computation, however, previous methods compute the OOD scores with limited usage of the in-distribution dataset. For instance, the OOD scores are computed with information from a small portion of the in-distribution data. Furthermore, these methods encode images with a neural image encoder. The robustness of these methods is rarely checked with respect to image encoders of different training methods and architectures. In this work, we introduce the diffusion process into the OOD task. The diffusion model integrates information on the whole training set into the predicted noise vectors. What's more, we deduce a closed-form solution for the noise vector (stable point). Then the noise vector is converted into our OOD score, we test both the deep model predicted noise vector and the closed-form noise vector on the OOD benchmarks \cite{openood}. Our method outperforms previous OOD methods across all types of image encoders (Table. \ref{main}). A $3.5\%$ performance gain is achieved with the MAE-based image encoder. Moreover, we studied the robustness of OOD methods by applying different types of image encoders. Some OOD methods failed to generalize well when switching image encoders from ResNet to Vision Transformers, our method performs exhibits good robustness with all the image encoders.

Out-of-Distribution with Text-to-Image Diffusion Models.

Exploiting Diffusion Prior for Out-of-Distribution Detection

Out-of-distribution Detection with Diffusion-based Neighborhood

NODI: Out-Of-Distribution Detection with Noise from Diffusion

Out-of-Distribution Detection with a Single Unconditional Diffusion Model

ITCD: Image to Text Translation for Classification by Diffusion Models

Beyond Perceptual Distances: Rethinking Disparity Assessment for Out-of-Distribution Detection with Diffusion Models

Dual Conditioned Diffusion Models for Out-Of-Distribution Detection: Application to Fetal Ultrasound Videos

Dream the Impossible: Outlier Imagination with Diffusion Models

Detecting Out-Of-Distribution Earth Observation Images with Diffusion Models

Diffusion Denoising Process for Perceptron Bias in Out-of-distribution Detection

Diffusion-Cap: A Diffusion Model for Image Captioning

Unsupervised Out-of-Distribution Detection with Diffusion Inpainting

Diffusion for Out-of-Distribution Detection on Road Scenes and Beyond

Exploring Discrete Diffusion Models for Image Captioning

DreamDistribution: Prompt Distribution Learning for Text-to-Image Diffusion Models

DIAGNOSIS: Detecting Unauthorized Data Usages in Text-to-image Diffusion Models

Odd: One-Class Anomaly Detection Via the Diffusion Model

Discffusion: Discriminative Diffusion Models as Few-shot Vision and Language Learners

A Survey of Data-Driven 2D Diffusion Models for Generating Images from Text