Abstract:In the dynamic realms of machine learning and deep learning, the robustness and reliability of models are paramount, especially in critical real-world applications. A fundamental challenge in this sphere is managing Out-of-Distribution (OOD) samples, significantly increasing the risks of model misclassification and uncertainty. Our work addresses this challenge by enhancing the detection and management of OOD samples in neural networks. We introduce OOD-R (Out-of-Distribution-Rectified), a meticulously curated collection of open-source datasets with enhanced noise reduction properties. In-Distribution (ID) noise in existing OOD datasets can lead to inaccurate evaluation of detection algorithms. Recognizing this, OOD-R incorporates noise filtering technologies to refine the datasets, ensuring a more accurate and reliable evaluation of OOD detection algorithms. This approach not only improves the overall quality of data but also aids in better distinguishing between OOD and ID samples, resulting in up to a 2.5\% improvement in model accuracy and a minimum 3.2\% reduction in false positives. Furthermore, we present ActFun, an innovative method that fine-tunes the model's response to diverse inputs, thereby improving the stability of feature extraction and minimizing specificity issues. ActFun addresses the common problem of model overconfidence in OOD detection by strategically reducing the influence of hidden units, which enhances the model's capability to estimate OOD uncertainty more accurately. Implementing ActFun in the OOD-R dataset has led to significant performance enhancements, including an 18.42\% increase in AUROC of the GradNorm method and a 16.93\% decrease in FPR95 of the Energy method. Overall, our research not only advances the methodologies in OOD detection but also emphasizes the importance of dataset integrity for accurate algorithm evaluation.

Distilling the Unknown to Unveil Certainty

The Best of Both Worlds: On the Dilemma of Out-of-distribution Detection

Advancing Out-of-Distribution Detection through Data Purification and Dynamic Activation Function Design

OAL: Enhancing OOD Detection Using Latent Diffusion

Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text

Rethinking Out-of-Distribution Detection on Imbalanced Data Distribution

Tolerant Self-Distillation for Image Classification

Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sources

Density-driven Regularization for Out-of-distribution Detection

Out-of-Distribution Identification: Let Detector Tell Which I Am Not Sure.

Supervision Adaptation Balancing In-distribution Generalization and Out-of-distribution Detection

When and How Does In-Distribution Label Help Out-of-Distribution Detection?

Mitigating Overconfidence in Out-of-Distribution Detection by Capturing Extreme Activations

IDa-Det: An Information Discrepancy-aware Distillation for 1-bit Detectors

Certifiably Adversarially Robust Detection of Out-of-Distribution Data

Meta OOD Learning for Continuously Adaptive OOD Detection

SKDF: A Simple Knowledge Distillation Framework for Distilling Open-Vocabulary Knowledge to Open-world Object Detector

Out-of-Distribution Learning with Human Feedback

Exploiting Mixed Unlabeled Data for Detecting Samples of Seen and Unseen Out-of-Distribution Classes.

Your Classifier Can Be Secretly a Likelihood-Based OOD Detector

Teaching with Uncertainty: Unleashing the Potential of Knowledge Distillation in Object Detection