Abstract:Out-of-distribution (OOD) detection aims to detect "unknown" data whose labels have not been seen during the in-distribution (ID) training process. Recent progress in representation learning gives rise to distance-based OOD detection that recognizes inputs as ID/OOD according to their relative distances to the training data of ID classes. Previous approaches calculate pairwise distances relying only on global image representations, which can be sub-optimal as the inevitable background clutter and intra-class variation may drive image-level representations from the same ID class far apart in a given representation space. In this work, we overcome this challenge by proposing Multi-scale OOD DEtection (MODE), a first framework leveraging both global visual information and local region details of images to maximally benefit OOD detection. Specifically, we first find that existing models pretrained by off-the-shelf cross-entropy or contrastive losses are incompetent to capture valuable local representations for MODE, due to the scale-discrepancy between the ID training and OOD detection processes. To mitigate this issue and encourage locally discriminative representations in ID training, we propose Attention-based Local PropAgation (ALPA), a trainable objective that exploits a cross-attention mechanism to align and highlight the local regions of the target objects for pairwise examples. During test-time OOD detection, a Cross-Scale Decision (CSD) function is further devised on the most discriminative multi-scale representations to distinguish ID/OOD data more faithfully. We demonstrate the effectiveness and flexibility of MODE on several benchmarks -- on average, MODE outperforms the previous state-of-the-art by up to 19.24% in FPR, 2.77% in AUROC. Code is available at <a class="link-external link-https" href="https://github.com/JimZAI/MODE-OOD" rel="external noopener nofollow">this https URL</a>.

CMG: A Class-Mixed Generation Approach to Out-of-Distribution Detection

Enhancing Out-of-Domain Detection for Speech Spoofing Countermeasure Via Supervised Contrastive Learning

Delving into Out-of-Distribution Detection with Vision-Language Representations

Out-of-Distribution Detection Using Peer-Class Generated by Large Language Model

General-Purpose Multi-Modal OOD Detection Framework

Learning by Erasing: Conditional Entropy based Transferable Out-Of-Distribution Detection

OOD Aware Supervised Contrastive Learning

Out-of-Distribution Detection and Selective Generation for Conditional Language Models

CADet: Fully Self-Supervised Out-Of-Distribution Detection With Contrastive Learning

A Novel Data Augmentation Technique for Out-of-Distribution Sample Detection using Compounded Corruptions

MultiOOD: Scaling Out-of-Distribution Detection for Multiple Modalities

Towards Reliable AI Model Deployments: Multiple Input Mixup for Out-of-Distribution Detection

Out-of-distribution Detection with Diffusion-based Neighborhood

Out-of-Distribution (OOD) Detection and Generalization Improved by Augmenting Adversarial Mixup Samples

TagOOD: A Novel Approach to Out-of-Distribution Detection via Vision-Language Representations and Class Center Learning

Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sources

Resultant: Incremental Effectiveness on Likelihood for Unsupervised Out-of-Distribution Detection

OAL: Enhancing OOD Detection Using Latent Diffusion

From Global to Local: Multi-scale Out-of-distribution Detection

A Unified Approach to Semi-Supervised Out-of-Distribution Detection

Augmenting the Softmax with Additional Confidence Scores for Improved Selective Classification with Out-of-Distribution Data