Abstract:Out-of-distribution (OOD) detection is critical for safety-sensitive machine learning applications and has been extensively studied, yielding a plethora of methods developed in the literature. However, most studies for OOD detection did not use pre-trained models and trained a backbone from scratch. In recent years, transferring knowledge from large pre-trained models to downstream tasks by lightweight tuning has become mainstream for training in-distribution (ID) classifiers. To bridge the gap between the practice of OOD detection and current classifiers, the unique and crucial problem is that the samples whose information networks know often come as OOD input. We consider that such data may significantly affect the performance of large pre-trained networks because the discriminability of these OOD data depends on the pre-training algorithm. Here, we define such OOD data as PT-OOD (Pre-Trained OOD) data. In this paper, we aim to reveal the effect of PT-OOD on the OOD detection performance of pre-trained networks from the perspective of pre-training algorithms. To achieve this, we explore the PT-OOD detection performance of supervised and self-supervised pre-training algorithms with linear-probing tuning, the most common efficient tuning method. Through our experiments and analysis, we find that the low linear separability of PT-OOD in the feature space heavily degrades the PT-OOD detection performance, and self-supervised models are more vulnerable to PT-OOD than supervised pre-trained models, even with state-of-the-art detection methods. To solve this vulnerability, we further propose a unique solution to large-scale pre-trained models: Leveraging powerful instance-by-instance discriminative representations of pre-trained models and detecting OOD in the feature space independent of the ID decision boundaries. The code will be available via <a class="link-external link-https" href="https://github.com/AtsuMiyai/PT-OOD" rel="external noopener nofollow">this https URL</a>.

Are Pretrained Transformers Robust in Intent Classification? A Missing Ingredient in Evaluation of Out-of-Scope Intent Detection

Protego: Detecting Adversarial Examples for Vision Transformers Via Intrinsic Capabilities

Revisiting Mahalanobis Distance for Transformer-Based Out-of-Domain Detection

Effectiveness of Pre-training for Few-shot Intent Classification

Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization

A new approach for fine-tuning sentence transformers for intent classification and out-of-scope detection tasks

Improved Out-of-Scope Intent Classification with Dual Encoding and Threshold-based Re-Classification

Few-shot out-of-scope intent classification: analyzing the robustness of prompt-based learning

Out-of-Scope Intent Detection with Self-Supervision and Discriminative Training

Pretrained Transformers Improve Out-of-Distribution Robustness

Training Object Detectors from Scratch: An Empirical Study in the Era of Vision Transformer

Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training

A Simple Interpretable Transformer for Fine-Grained Image Classification and Analysis

Towards Open Environment Intent Prediction.

Investigating the Robustness and Properties of Detection Transformers (DETR) Toward Difficult Images

Pretrained Transformers Do not Always Improve Robustness

The Open-World Lottery Ticket Hypothesis for OOD Intent Classification

VI-OOD: A Unified Representation Learning Framework for Textual Out-of-distribution Detection

Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for Out-of-Domain Detection

Can Pre-trained Networks Detect Familiar Out-of-Distribution Data?

Uncertainty-Guided Transformer Reasoning for Camouflaged Object Detection.