Abstract:Existing out-of-distribution detection models rely on the prediction of a single classifier and are sensitive to classifier bias, making it difficult to discriminate similar feature out-of-distribution data. This article proposed a multi-classifier-based model and two strategies to enhance the performance of the model. The model first trains several different base classifiers and obtains the predictions of the test data on each base classifier, then uses cross-entropy to calculate the dispersion between these predictions, and finally uses the dispersion as a metric to identify the out-of-distribution data. A large scatter implies inconsistency in the predictions of the base classifier, and the greater the probability of belonging to the out-of-distribution data. The first strategy is applied in the training process of the model to increase the difference between base classifiers by using various scales of Label smoothing regularisation. The second strategy is applied to the inference process of the model by changing the mean and variance of the activations in the neural network to perturb the inference results of the test data. These two strategies can effectively amplify the discrepancy in the dispersion of the in-distribution and out-of-distribution data. The experimental results show that the method in this article can effectively improve the performance of the model in the detection of different types of out-of-distribution data, improve the robustness of deep neural networks (DNN) in the face of unknown classes, and promote the application of DNN in systems and engineering with high security requirements.

Boosting Out-of-Distribution Image Detection With Epistemic Uncertainty

Uncertainty-Aware Out-of-Distribution Detection with Gaussian Processes

Out-of-distribution Object Detection through Bayesian Uncertainty Estimation

Uncertainty Modeling for Out-of-Distribution Generalization

Ensemble Distillation for Out-of-distribution Detection

Uncertainty-Based Out-of-Distribution Detection in Deep Reinforcement Learning

Gradient-Regularized Out-of-Distribution Detection

Out-of-distribution Detection Based on Multi-Classifiers

Out-of-distribution Detection and Generation using Soft Brownian Offset Sampling and Autoencoders

Towards In-Distribution Compatible Out-of-Distribution Detection.

Toward a Realistic Benchmark for Out-of-Distribution Detection

Mitigating Overconfidence in Out-of-Distribution Detection by Capturing Extreme Activations

Boosting Out-of-distribution Detection with Typical Features

Mahalanobis-Aware Training for Out-of-Distribution Detection

Out-of-Distribution Detection by Cross-Class Vicinity Distribution of In-Distribution Data

Deep Dirichlet uncertainty for unsupervised out-of-distribution detection of eye fundus photographs in glaucoma screening

Learning by Erasing: Conditional Entropy based Transferable Out-Of-Distribution Detection

Towards Out-of-Distribution Detection for breast cancer classification in Point-of-Care Ultrasound Imaging

A Simple Test-Time Method for Out-of-Distribution Detection

DOS: Diverse Outlier Sampling for Out-of-Distribution Detection

Uncertainty Estimation and Out-of-Distribution Detection for LiDAR Scene Semantic Segmentation