Abstract:One key challenge in Out-of-Distribution (OOD) detection is the absence of ground-truth OOD samples during training. One principled approach to address this issue is to use samples from external datasets as outliers (i.e., pseudo OOD samples) to train OOD detectors. However, we find empirically that the outlier samples often present a distribution shift compared to the true OOD samples, especially in Long-Tailed Recognition (LTR) scenarios, where ID classes are heavily imbalanced, \ie, the true OOD samples exhibit very different probability distribution to the head and tailed ID classes from the outliers. In this work, we propose a novel approach, namely normalized outlier distribution adaptation (AdaptOD), to tackle this distribution shift problem. One of its key components is dynamic outlier distribution adaptation that effectively adapts a vanilla outlier distribution based on the outlier samples to the true OOD distribution by utilizing the OOD knowledge in the predicted OOD samples during inference. Further, to obtain a more reliable set of predicted OOD samples on long-tailed ID data, a novel dual-normalized energy loss is introduced in AdaptOD, which leverages class- and sample-wise normalized energy to enforce a more balanced prediction energy on imbalanced ID samples. This helps avoid bias toward the head samples and learn a substantially better vanilla outlier distribution than existing energy losses during training. It also eliminates the need of manually tuning the sensitive margin hyperparameters in energy losses. Empirical results on three popular benchmarks for OOD detection in LTR show the superior performance of AdaptOD over state-of-the-art methods. Code is available at \url{<a class="link-external link-https" href="https://github.com/mala-lab/AdaptOD" rel="external noopener nofollow">this https URL</a>}.

When an extra rejection class meets out-of-distribution detection in long-tailed image classification

Out-of-Distribution Detection in Long-Tailed Recognition with Calibrated Outlier Class Learning

Rethinking Out-of-Distribution Detection on Imbalanced Data Distribution

Long-Tailed Out-of-Distribution Detection: Prioritizing Attention to Tail

Class Relevance Learning For Out-of-distribution Detection

Representation Norm Amplification for Out-of-Distribution Detection in Long-Tail Learning

Out-of-Distribution Detection for Long-tailed and Fine-grained Skin Lesion Images

Three Factors to Improve Out-of-Distribution Detection

Long-Tailed Out-of-Distribution Detection via Normalized Outlier Distribution Adaptation

OAL: Enhancing OOD Detection Using Latent Diffusion

Improving Out-of-Distribution Detection with Disentangled Foreground and Background Features

Density-driven Regularization for Out-of-distribution Detection

A Simple Test-Time Method for Out-of-Distribution Detection

Zero-Shot Out-of-Distribution Detection with Outlier Label Exposure

Towards In-Distribution Compatible Out-of-Distribution Detection.

CASE: Exploiting Intra-class Compactness and Inter-class Separability of Feature Embeddings for Out-of-Distribution Detection

FodFoM: Fake Outlier Data by Foundation Models Creates Stronger Visual Out-of-Distribution Detector

Out-of-Distribution Detection Using Peer-Class Generated by Large Language Model

Out-of-Distribution Learning with Human Feedback

Envisioning Outlier Exposure by Large Language Models for Out-of-Distribution Detection

Out-of-Distribution Detection by Cross-Class Vicinity Distribution of In-Distribution Data