Abstract:Though deep neural networks have achieved impressive success on various vision tasks, obvious performance degradation still exists when models are tested in out-of-distribution scenarios. In addressing this limitation, we ponder that the feature statistics (mean and standard deviation), which carry the domain characteristics of the training data, can be properly manipulated to improve the generalization ability of deep learning models. Existing methods commonly consider feature statistics as deterministic values measured from the learned features and do not explicitly model the uncertain statistics discrepancy caused by potential domain shifts during testing. In this paper, we improve the network generalization ability by modeling domain shifts with uncertainty (DSU), i.e., characterizing the feature statistics as uncertain distributions during training. Specifically, we hypothesize that the feature statistic, after considering the potential uncertainties, follows a multivariate Gaussian distribution. During inference, we propose an instance-wise adaptation strategy that can adaptively deal with the unforeseeable shift and further enhance the generalization ability of the trained model with negligible additional cost. We also conduct theoretical analysis on the aspects of generalization error bound and the implicit regularization effect, showing the efficacy of our method. Extensive experiments demonstrate that our method consistently improves the network generalization ability on multiple vision tasks, including image classification, semantic segmentation, instance retrieval, and pose estimation. Our methods are simple yet effective and can be readily integrated into networks without additional trainable parameters or loss constraints. Code will be released in <a class="link-external link-https" href="https://github.com/lixiaotong97/DSU" rel="external noopener nofollow">this https URL</a>.

Dual-Supervised Uncertainty Inference of MoGMM-FC Layer for Image Recognition

DS-UI: Dual-Supervised Mixture of Gaussian Mixture Models for Uncertainty Inference in Image Recognition.

DS-UI: Dual-Supervised Mixture of Gaussian Mixture Models for Uncertainty Inference

Uncertainty-Debiased Multimodal Fusion: Learning Deterministic Joint Representation for Multimodal Sentiment Analysis

Gaussian Mixture Distribution Makes Data Uncertainty Learning Better

Confidence-weighted Mutual Supervision on Dual Networks for Unsupervised Cross-Modality Image Segmentation

Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributions

Modeling Uncertain Feature Representation for Domain Generalization

Informative Data Selection With Uncertainty for Multimodal Object Detection

Digging into Uncertainty in Self-supervised Multi-view Stereo

Uncertainty-Guided Domain Alignment for Layer Segmentation in OCT Images

Uncertainty aware audiovisual activity recognition using deep Bayesian variational inference

Uncertainty Quantification via Hölder Divergence for Multi-View Representation Learning

Boosting Out-of-Distribution Image Detection With Epistemic Uncertainty

High-Order Distance-Based Multiview Stochastic Learning in Image Classification

Informative Data Selection with Uncertainty for Multi-modal Object Detection

Inter- and intra-uncertainty based feature aggregation model for semi-supervised histopathology image segmentation

Probabilistic MIMO U-Net: Efficient and Accurate Uncertainty Estimation for Pixel-wise Regression

Uncertainty Modeling for Out-of-Distribution Generalization

Deep Multiview Union Learning Network for Multisource Image Classification.

Towards Generalizable Medical Image Segmentation with Pixel-wise Uncertainty Estimation