Abstract:Out-of-distribution (OOD) detection aims to detect "unknown" data whose labels have not been seen during the in-distribution (ID) training process. Recent progress in representation learning gives rise to distance-based OOD detection that recognizes inputs as ID/OOD according to their relative distances to the training data of ID classes. Previous approaches calculate pairwise distances relying only on global image representations, which can be sub-optimal as the inevitable background clutter and intra-class variation may drive image-level representations from the same ID class far apart in a given representation space. In this work, we overcome this challenge by proposing Multi-scale OOD DEtection (MODE), a first framework leveraging both global visual information and local region details of images to maximally benefit OOD detection. Specifically, we first find that existing models pretrained by off-the-shelf cross-entropy or contrastive losses are incompetent to capture valuable local representations for MODE, due to the scale-discrepancy between the ID training and OOD detection processes. To mitigate this issue and encourage locally discriminative representations in ID training, we propose Attention-based Local PropAgation (ALPA), a trainable objective that exploits a cross-attention mechanism to align and highlight the local regions of the target objects for pairwise examples. During test-time OOD detection, a Cross-Scale Decision (CSD) function is further devised on the most discriminative multi-scale representations to distinguish ID/OOD data more faithfully. We demonstrate the effectiveness and flexibility of MODE on several benchmarks -- on average, MODE outperforms the previous state-of-the-art by up to 19.24% in FPR, 2.77% in AUROC. Code is available at <a class="link-external link-https" href="https://github.com/JimZAI/MODE-OOD" rel="external noopener nofollow">this https URL</a>.

Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancement

Extremely Simple Activation Shaping for Out-of-Distribution Detection

Logit Scaling for Out-of-Distribution Detection

Advancing Out-of-Distribution Detection through Data Purification and Dynamic Activation Function Design

Mitigating Overconfidence in Out-of-Distribution Detection by Capturing Extreme Activations

Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection Capability

From Global to Local: Multi-scale Out-of-distribution Detection

Towards Optimal Feature-Shaping Methods for Out-of-Distribution Detection

Discriminability-Driven Channel Selection for Out-of-Distribution Detection

Rethinking Out-of-Distribution Detection on Imbalanced Data Distribution

OAL: Enhancing OOD Detection Using Latent Diffusion

Re-Benchmarking Out-of-Distribution Detection in Deep Neural Networks

Exploring Simple, High Quality Out-of-Distribution Detection with L2 Normalization

Three Factors to Improve Out-of-Distribution Detection

Boosting Out-of-distribution Detection with Typical Features

Towards Few-shot Out-of-Distribution Detection

CASE: Exploiting Intra-class Compactness and Inter-class Separability of Feature Embeddings for Out-of-Distribution Detection

Towards In-Distribution Compatible Out-of-Distribution Detection.

Detecting Out-of-Distribution Examples Via Class-Conditional Impressions Reappearing

The Best of Both Worlds: On the Dilemma of Out-of-distribution Detection

Going Beyond Conventional OOD Detection