Abstract:The ability of a deep learning network to distinguish between in-distribution (ID) and out-of-distribution (OOD) inputs is crucial for ensuring the reliability and trustworthiness of AI systems. Existing OOD detection methods often involve complex architectural innovations, such as ensemble models, which, while enhancing detection accuracy, significantly increase model complexity and training time. Other methods utilize surrogate samples to simulate OOD inputs, but these may not generalize well across different types of OOD data. In this paper, we propose a straightforward yet novel technique to enhance OOD detection in pre-trained networks without altering its original parameters. Our approach defines probabilistic trust intervals for each network weight, determined using in-distribution data. During inference, additional weight values are sampled, and the resulting disagreements among outputs are utilized for OOD detection. We propose a metric to quantify this disagreement and validate its effectiveness with empirical evidence. Our method significantly outperforms various baseline methods across multiple OOD datasets without requiring actual or surrogate OOD samples. We evaluate our approach on MNIST, Fashion-MNIST, CIFAR-10, CIFAR-100 and CIFAR-10-C (a corruption-augmented version of CIFAR-10), across various neural network architectures (e.g., VGG-16, ResNet-20, DenseNet-100). On the MNIST-FashionMNIST setup, our method achieves a False Positive Rate (FPR) of 12.46\% at 95\% True Positive Rate (TPR), compared to 27.09\% achieved by the best baseline. On adversarial and corrupted datasets such as CIFAR-10-C, our proposed method easily differentiate between clean and noisy inputs. These results demonstrate the robustness of our approach in identifying corrupted and adversarial inputs, all without requiring OOD samples during training.

Uncertainty-Based Out-of-Distribution Detection in Deep Reinforcement Learning

Benchmark for Out-of-Distribution Detection in Deep Reinforcement Learning

Rethinking Out-of-Distribution Detection for Reinforcement Learning: Advancing Methods for Evaluation and Detection

Re-Benchmarking Out-of-Distribution Detection in Deep Neural Networks

Out-of-distribution detection for regression tasks: parameter versus predictor entropy

Boosting Out-of-Distribution Image Detection With Epistemic Uncertainty

The Peril of Popular Deep Learning Uncertainty Estimation Methods

Uncertainty-Aware Out-of-Distribution Detection with Gaussian Processes

Out-of-Distribution Detection with Hilbert-Schmidt Independence Optimization

A statistical framework for efficient out of distribution detection in deep neural networks

Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning

DARL: Distance-Aware Uncertainty Estimation for Offline Reinforcement Learning.

Out-of-distribution Object Detection through Bayesian Uncertainty Estimation

DOODLER: Determining Out-Of-Distribution Likelihood from Encoder Reconstructions

Continual Unsupervised Out-of-Distribution Detection

RBUE: A ReLU-Based Uncertainty Estimation Method of Deep Neural Networks

Probabilistic Trust Intervals for Out of Distribution Detection

Ensemble Distillation for Out-of-distribution Detection

Dropout Strikes Back: Improved Uncertainty Estimation via Diversity Sampling

Uncertainty Estimation and Out-of-Distribution Detection for LiDAR Scene Semantic Segmentation

Exploration Via Distributional Reinforcement Learning with Epistemic and Aleatoric Uncertainty Estimation*