Abstract:Out-of-distribution (OOD) detection plays a vital role in enhancing the reliability of machine learning (ML) models. The emergence of large language models (LLMs) has catalyzed a paradigm shift within the ML community, showcasing their exceptional capabilities across diverse natural language processing tasks. While existing research has probed OOD detection with relative small-scale Transformers like BERT, RoBERTa and GPT-2, the stark differences in scales, pre-training objectives, and inference paradigms call into question the applicability of these findings to LLMs. This paper embarks on a pioneering empirical investigation of OOD detection in the domain of LLMs, focusing on LLaMA series ranging from 7B to 65B in size. We thoroughly evaluate commonly-used OOD detectors, scrutinizing their performance in both zero-grad and fine-tuning scenarios. Notably, we alter previous discriminative in-distribution fine-tuning into generative fine-tuning, aligning the pre-training objective of LLMs with downstream tasks. Our findings unveil that a simple cosine distance OOD detector demonstrates superior efficacy, outperforming other OOD detectors. We provide an intriguing explanation for this phenomenon by highlighting the isotropic nature of the embedding spaces of LLMs, which distinctly contrasts with the anisotropic property observed in smaller BERT family models. The new insight enhances our understanding of how LLMs detect OOD data, thereby enhancing their adaptability and reliability in dynamic environments. We have released the source code at \url{<a class="link-external link-https" href="https://github.com/Awenbocc/LLM-OOD" rel="external noopener nofollow">this https URL</a>} for other researchers to reproduce our results.

Reframing the Relationship in Out-of-Distribution Detection

Exploring Large Language Models for Multi-Modal Out-of-Distribution Detection

How Good Are LLMs at Out-of-Distribution Detection?

Delving into Out-of-Distribution Detection with Vision-Language Representations

'No' Matters: Out-of-Distribution Detection in Multimodality Long Dialogue

Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Need

Out-of-Distribution Detection Using Peer-Class Generated by Large Language Model

Enhancing Out-of-Distribution Detection with Multitesting-based Layer-wise Feature Fusion

TagOOD: A Novel Approach to Out-of-Distribution Detection via Vision-Language Representations and Class Center Learning

COOD: Concept-based Zero-shot OOD Detection

Matching Words for Out-of-distribution Detection

DALD: Improving Logits-based Detector without Logits from Black-box LLMs

Out-of-Distribution Detection by Principal Component Correspondence

A Survey on Out-of-Distribution Detection in NLP

Large Language Models for Anomaly and Out-of-Distribution Detection: A Survey

Learning Multi-Manifold Embedding for Out-Of-Distribution Detection

Class Relevance Learning For Out-of-distribution Detection

Beyond the Known: Investigating LLMs Performance on Out-of-Domain Intent Detection

How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Study

Rethinking Out-of-Distribution Detection From a Human-Centric Perspective

Out-of-Distribution Detection via Deep Multi-Comprehension Ensemble