Abstract:Reliable use of deep neural networks (DNNs) for medical image analysis requires methods to identify inputs that differ significantly from the training data, called out-of-distribution (OOD), to prevent erroneous predictions. OOD detection methods can be categorised as either confidence-based (using the model's output layer for OOD detection) or feature-based (not using the output layer). We created two new OOD benchmarks by dividing the D7P (dermatology) and BreastMNIST (ultrasound) datasets into subsets which either contain or don't contain an artefact (rulers or annotations respectively). Models were trained with artefact-free images, and images with the artefacts were used as OOD test sets. For each OOD image, we created a counterfactual by manually removing the artefact via image processing, to assess the artefact's impact on the model's predictions. We show that OOD artefacts can boost a model's softmax confidence in its predictions, due to correlations in training data among other factors. This contradicts the common assumption that OOD artefacts should lead to more uncertain outputs, an assumption on which most confidence-based methods rely. We use this to explain why feature-based methods (e.g. Mahalanobis score) typically have greater OOD detection performance than confidence-based methods (e.g. MCP). However, we also show that feature-based methods typically perform worse at distinguishing between inputs that lead to correct and incorrect predictions (for both OOD and ID data). Following from these insights, we argue that a combination of feature-based and confidence-based methods should be used within DNN pipelines to mitigate their respective weaknesses. These project's code and OOD benchmarks are available at: <a class="link-external link-https" href="https://github.com/HarryAnthony/Evaluating_OOD_detection" rel="external noopener nofollow">this https URL</a>.

Out-of-Distribution Detection for Medical Applications: Guidelines for Practical Evaluation

Out-of-distribution Detection in Medical Image Analysis: A survey

Redesigning Out-of-Distribution Detection on 3D Medical Images

Unmasking the Chameleons: A Benchmark for Out-of-Distribution Detection in Medical Tabular Data

MOOD 2020: A public Benchmark for Out-of-Distribution Detection and Localization on medical Images

Out-of-Distribution Detection and Radiological Data Monitoring Using Statistical Process Control

Rule-based Out-Of-Distribution Detection

Towards Out-of-Distribution Detection for breast cancer classification in Point-of-Care Ultrasound Imaging

Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery

Out-of-Distribution Detection for Learning-Based Chest X-Ray Diagnosis.

Fine-Grained Out-of-Distribution Detection of Medical Images Using Combination of Feature Uncertainty and Mahalanobis Distance.

Are We Ready for Out-of-Distribution Detection in Digital Pathology?

Evaluating Reliability in Medical DNNs: A Critical Analysis of Feature and Confidence-Based OOD Detection

Taming False Positives in Out-of-Distribution Detection with Human Feedback

Toward a Realistic Benchmark for Out-of-Distribution Detection

Abstract: MOOD 2020

Limitations of Out-of-Distribution Detection in 3D Medical Image Segmentation

Improving Out-of-Distribution Detection by Combining Existing Post-hoc Methods

A Survey on Out-of-Distribution Detection in NLP

Practical Evaluation of Out-of-Distribution Detection Methods for Image Classification

Out-of-distribution Reject Option Method for Dataset Shift Problem in Early Disease Onset Prediction