Abstract:Background: The willingness to trust predictions formulated by automatic algorithms is key in a wide range of domains. However, a vast number of deep architectures are only able to formulate predictions without associated uncertainty. Purpose: In this study, we propose a method to convert a standard neural network into a Bayesian neural network and estimate the variability of predictions by sampling different networks similar to the original one at each forward pass. Methods: We combine our method with a tunable rejection-based approach that employs only the fraction of the data, i.e., the share that the model can classify with an uncertainty below a user-set threshold. We test our model in a large cohort of brain images from patients with Alzheimer's disease and healthy controls, discriminating the former and latter classes based on morphometric images exclusively. Results: We demonstrate how combining estimated uncertainty with a rejection-based approach increases classification accuracy from 0.86 to 0.95 while retaining 75% of the test set. In addition, the model can select the cases to be recommended for, e.g., expert human evaluation due to excessive uncertainty. Importantly, our framework circumvents additional workload during the training phase by using our network "turned into Bayesian" to implicitly investigate the loss landscape in the neighborhood of each test sample in order to determine the reliability of the predictions. Conclusion: We believe that being able to estimate the uncertainty of a prediction, along with tools that can modulate the behavior of the network to a degree of confidence that the user is informed about (and comfortable with), can represent a crucial step in the direction of user compliance and easier integration of deep learning tools into everyday tasks currently performed by human operators.

Uncertainty-aware Dynamic Re-weighting Robust Classification

Noise is the Fatal Poison: A Noise-aware Network for Noisy Dataset Classification

Uncertainty-Aware Learning against Label Noise on Imbalanced Datasets

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

Dynamic ensemble selection based on Deep Neural Network Uncertainty Estimation for Adversarial Robustness

Quantifying Uncertainty in Deep Learning Classification with Noise in Discrete Inputs for Risk-Based Decision Making

Confidence-based Reliable Learning under Dual Noises

Multidimensional Uncertainty Quantification for Deep Neural Networks

Robust adversarial uncertainty quantification for deep learning fine-tuning

Uncertainty-Aware Multi-View Representation Learning

A Simple Framework to Quantify Different Types of Uncertainty in Deep Neural Networks for Image Classification

Which Strategies Matter for Noisy Label Classification? Insight into Loss and Uncertainty

BayesNetCNN: incorporating uncertainty in neural networks for image-based classification tasks

Roxithromycin, a new macrolide antibiotic, in the treatment of infections in the lower respiratory tract: an overview.

Improving Medical Images Classification with Label Noise Using Dual-Uncertainty Estimation

Generalized Uncertainty of Deep Neural Networks: Taxonomy and Applications

Adaptive Retraining for Neural Network Robustness in Classification

Uncertainty Calibration with Energy Based Instance-wise Scaling in the Wild Dataset

Enabling uncertainty estimation in neural networks through weight perturbation for improved Alzheimer's disease classification

[Catecholamines in carotid glomus. Autoradiographic studies on catecholamine- and amino acid-metabolism using H-3-phenylalanine].

Integrating uncertainty quantification into randomized smoothing based robustness guarantees