Abstract:In this work, we propose CODE, an extension of existing work from the field of explainable AI that identifies class-specific recurring patterns to build a robust Out-of-Distribution (OoD) detection method for visual classifiers. CODE does not require any classifier retraining and is OoD-agnostic, i.e., tuned directly to the training dataset. Crucially, pattern identification allows us to provide images from the In-Distribution (ID) dataset as reference data to provide additional context to the confidence scores. In addition, we introduce a new benchmark based on perturbations of the ID dataset that provides a known and quantifiable measure of the discrepancy between the ID and OoD datasets serving as a reference value for the comparison between OoD detection methods.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: how to construct a robust out - of - distribution (OoD) detection method that can provide context information to explain its decisions without retraining the original classifier. Specifically, the paper proposes a method named CODE. This method enhances existing explainable AI techniques by identifying class - specific repeating patterns, thereby achieving OoD detection for visual classifiers. In addition, the paper also introduces a new benchmark test. This benchmark, based on perturbations of the in - distribution (ID) dataset, provides a method for quantifying the difference between ID and OoD datasets as a reference value for comparing different OoD detection methods. ### Main contributions: 1. **New benchmark test**: A new benchmark test based on ID dataset perturbations is proposed. This test provides a known and quantifiable measure of the difference between ID and OoD datasets as a reference value for comparing different OoD detection methods. 2. **CODE method**: A OoD detection method named CODE is proposed. This method does not require fine - tuning of the original classifier. Through pattern recognition, CODE can use images in the ID dataset as reference points to provide additional context information to explain its decisions. 3. **Experimental verification**: Through extensive experiments, the effectiveness of the CODE method is verified and it is compared with other existing methods. ### Key techniques: - **Pattern recognition**: By identifying class - specific repeating patterns, context information is provided to explain OoD detection results. - **Confidence function**: A class - conditional confidence function is constructed to evaluate the probability that each input sample belongs to ID or OoD. - **Perturbation benchmark test**: By applying perturbations of different intensities (such as Gaussian noise, Gaussian blur, luminance change and rotation), the consistency of OoD detection methods is evaluated. ### Experimental results: - **Cross - dataset OoD detection**: Experiments were carried out on multiple datasets. The results show that CODE is comparable to most existing methods in terms of OoD detection ability. - **Perturbation consistency**: Through the perturbation benchmark test, CODE shows a stronger correlation with perturbation intensity, indicating that its performance is more consistent under different perturbations. Overall, this paper aims to improve the interpretability and robustness of OoD detection by introducing new OoD detection methods and benchmark tests.

Contextualised Out-of-Distribution Detection using Pattern Identication

Interpretable Out-Of-Distribution Detection Using Pattern Identification

ImageNet-OOD: Deciphering Modern Out-of-Distribution Detection Algorithms

Detecting Out-of-Distribution Examples Via Class-Conditional Impressions Reappearing

MOODv2: Masked Image Modeling for Out-of-Distribution Detection

A noisy elephant in the room: Is your out-of-distribution detector robust to label noise?

Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Need

Class Relevance Learning For Out-of-distribution Detection

Concept-based Explanations for Out-Of-Distribution Detectors

Out-of-Distribution Identification: Let Detector Tell Which I Am Not Sure.

Matching Words for Out-of-distribution Detection

Category-Extensible Out-of-Distribution Detection via Hierarchical Context Descriptions

From Global to Local: Multi-scale Out-of-distribution Detection

Toward a Realistic Benchmark for Out-of-Distribution Detection

YolOOD: Utilizing Object Detection Concepts for Multi-Label Out-of-Distribution Detection

Look Around and Find Out: OOD Detection with Relative Angles

A framework for benchmarking class-out-of-distribution detection and its application to ImageNet

Unveiling the unseen: novel strategies for object detection beyond known distributions

Out-of-Distribution Detection by Principal Component Correspondence

Recent Advances in OOD Detection: Problems and Approaches

Deep Learning-Based Out-of-distribution Source Code Data Identification: How Far Have We Gone?