Abstract:The ability of a deep learning network to distinguish between in-distribution (ID) and out-of-distribution (OOD) inputs is crucial for ensuring the reliability and trustworthiness of AI systems. Existing OOD detection methods often involve complex architectural innovations, such as ensemble models, which, while enhancing detection accuracy, significantly increase model complexity and training time. Other methods utilize surrogate samples to simulate OOD inputs, but these may not generalize well across different types of OOD data. In this paper, we propose a straightforward yet novel technique to enhance OOD detection in pre-trained networks without altering its original parameters. Our approach defines probabilistic trust intervals for each network weight, determined using in-distribution data. During inference, additional weight values are sampled, and the resulting disagreements among outputs are utilized for OOD detection. We propose a metric to quantify this disagreement and validate its effectiveness with empirical evidence. Our method significantly outperforms various baseline methods across multiple OOD datasets without requiring actual or surrogate OOD samples. We evaluate our approach on MNIST, Fashion-MNIST, CIFAR-10, CIFAR-100 and CIFAR-10-C (a corruption-augmented version of CIFAR-10), across various neural network architectures (e.g., VGG-16, ResNet-20, DenseNet-100). On the MNIST-FashionMNIST setup, our method achieves a False Positive Rate (FPR) of 12.46\% at 95\% True Positive Rate (TPR), compared to 27.09\% achieved by the best baseline. On adversarial and corrupted datasets such as CIFAR-10-C, our proposed method easily differentiate between clean and noisy inputs. These results demonstrate the robustness of our approach in identifying corrupted and adversarial inputs, all without requiring OOD samples during training.

Towards Trustworthy Dataset Distillation

Dataset Distillation from First Principles: Integrating Core Information Extraction and Purposeful Learning

Accelerating Dataset Distillation Via Model Augmentation

A Comprehensive Study on Dataset Distillation: Performance, Privacy, Robustness and Fairness

Dataset Distillation: A Comprehensive Review

Dataset Distillers Are Good Label Denoisers In the Wild

Exploiting Inter-sample and Inter-feature Relations in Dataset Distillation

FairDD: Fair Dataset Distillation via Synchronized Matching

Embarassingly Simple Dataset Distillation

A Comprehensive Survey of Dataset Distillation

Group Distributionally Robust Dataset Distillation with Risk Minimization

Distributed Boosting: an Enhancing Method on Dataset Distillation

Emphasizing Discriminative Features for Dataset Distillation in Complex Scenarios

Dataset Distillation for Offline Reinforcement Learning

On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm

Dataset Distillation in Latent Space

Probabilistic Trust Intervals for Out of Distribution Detection

The Best of Both Worlds: On the Dilemma of Out-of-distribution Detection

Dataset Distillation via Factorization

Importance-Aware Adaptive Dataset Distillation

Not All Samples Should Be Utilized Equally: Towards Understanding and Improving Dataset Distillation