Abstract:Deep neural networks have repeatedly been shown to be non-robust to the uncertainties of the real world, even to naturally occurring ones. A vast majority of current approaches have focused on data-augmentation methods to expand the range of perturbations that the classifier is exposed to while training. A relatively unexplored avenue that is equally promising involves sanitizing an image as a preprocessing step, depending on the nature of perturbation. In this paper, we propose to use control for learned models to recover from distribution shifts online. Specifically, our method applies a sequence of semantic-preserving transformations to bring the shifted data closer in distribution to the training set, as measured by the Wasserstein distance. Our approach is to 1) formulate the problem of distribution shift recovery as a Markov decision process, which we solve using reinforcement learning, 2) identify a minimum condition on the data for our method to be applied, which we check online using a binary classifier, and 3) employ dimensionality reduction through orthonormal projection to aid in our estimates of the Wasserstein distance. We provide theoretical evidence that orthonormal projection preserves characteristics of the data at the distributional level. We apply our distribution shift recovery approach to the ImageNet-C benchmark for distribution shifts, demonstrating an improvement in average accuracy of up to 14.21% across a variety of state-of-the-art ImageNet classifiers. We further show that our method generalizes to composites of shifts from the ImageNet-C benchmark, achieving improvements in average accuracy of up to 9.81%. Finally, we test our method on CIFAR-100-C and report improvements of up to 8.25%.

Deep Distributionally Robust Learning for Calibrated Uncertainties under Domain Shift

Learning Calibrated Uncertainties for Domain Shift: a Distributionally Robust Learning Approach

Robust Calibration with Multi-domain Temperature Scaling

A Novel Unsupervised Post-Processing Calibration Method for DNNS with Robustness to Domain Shift

Robust Calibration For Improved Weather Prediction Under Distributional Shift

Incorporating Unlabeled Data into Distributionally Robust Learning

Post-hoc Uncertainty Calibration for Domain Drift Scenarios

Confidence Calibration for Domain Generalization under Covariate Shift

DC4L: Distribution Shift Recovery via Data-Driven Control for Deep Learning Models

Dirichlet-based Uncertainty Calibration for Active Domain Adaptation

Uncertainty-Aware Dynamic Learning for Cross-Domain Few-Shot Scene Classification from Remote Sensing Imagery

Multiply Robust Estimation for Local Distribution Shifts with Multiple Domains

Tackling Long-Tailed Category Distribution under Domain Shifts.

Distributionally Robust Constrained Reinforcement Learning under Strong Duality

Optimal Aggregation of Prediction Intervals under Unsupervised Domain Shift

Privacy Preserving Recalibration under Domain Shift

DWLR: Domain Adaptation under Label Shift for Wearable Sensor

Distribution-free uncertainty quantification for classification under label shift

Unsupervised Domain Adaptation via Calibrating Uncertainties

Learning Invariant Representations and Risks for Semi-supervised Domain Adaptation

A Risk Minimization Framework for Domain Adaptation