Abstract:Out-of-distribution detection (OOD) is a crucial technique for deploying machine learning models in the real world to handle the unseen scenarios. In this paper, we first propose a simple yet effective Neural Activation Prior (NAP) for OOD detection. Our neural activation prior is based on a key observation that, for a channel before the global pooling layer of a fully trained neural network, the probability of a few neurons being activated with a large response by an in-distribution (ID) sample is significantly higher than that by an OOD sample. An intuitive explanation is that for a model fully trained on ID dataset, each channel would play a role in detecting a certain pattern in the ID dataset, and a few neurons can be activated with a large response when the pattern is detected in an input sample. Then, a new scoring function based on this prior is proposed to highlight the role of these strongly activated neurons in OOD detection. Our approach is plug-and-play and does not lead to any performance degradation on ID data classification and requires no extra training or statistics from training or external datasets. Notice that previous methods primarily rely on post-global-pooling features of the neural networks, while the within-channel distribution information we leverage would be discarded by the global pooling operator. Consequently, our method is orthogonal to existing approaches and can be effectively combined with them in various applications. Experimental results show that our method achieves the state-of-the-art performance on CIFAR benchmark and ImageNet dataset, which demonstrates the power of the proposed prior. Finally, we extend our method to Transformers and the experimental findings indicate that NAP can also significantly enhance the performance of OOD detection on Transformers, thereby demonstrating the broad applicability of this prior knowledge.

Detection of out-of-distribution samples using binary neuron activation patterns

Detecting Out-of-distribution Objects Using Neuron Activation Patterns

Out-of-Distribution Detection using Neural Activation Prior

Neuron Activation Coverage: Rethinking Out-of-distribution Detection and Generalization

Out-of-Distribution Detection with Deep Nearest Neighbors

FOOD: Fast Out-Of-Distribution Detector

Detecting Out-of-Distribution Examples with In-distribution Examples and Gram Matrices

Are all outliers alike? On Understanding the Diversity of Outliers for Detecting OODs

Toward a Realistic Benchmark for Out-of-Distribution Detection

Detecting Out-of-Distribution Through the Lens of Neural Collapse

Out-of-Distribution Detection Using Outlier Detection Methods

Mitigating Overconfidence in Out-of-Distribution Detection by Capturing Extreme Activations

Mahalanobis-Aware Training for Out-of-Distribution Detection

LINe: Out-of-Distribution Detection by Leveraging Important Neurons

A Simple Test-Time Method for Out-of-Distribution Detection

Low-Dimensional Gradient Helps Out-of-Distribution Detection

Out-of-Distribution Detection & Applications With Ablated Learned Temperature Energy

Advancing Out-of-Distribution Detection through Data Purification and Dynamic Activation Function Design

Rethinking Out-of-Distribution Detection From a Human-Centric Perspective

Out-of-Distribution Data: An Acquaintance of Adversarial Examples -- A Survey

Density-driven Regularization for Out-of-distribution Detection