Abstract:Though deep neural networks have achieved impressive success on various vision tasks, obvious performance degradation still exists when models are tested in out-of-distribution scenarios. In addressing this limitation, we ponder that the feature statistics (mean and standard deviation), which carry the domain characteristics of the training data, can be properly manipulated to improve the generalization ability of deep learning models. Existing methods commonly consider feature statistics as deterministic values measured from the learned features and do not explicitly model the uncertain statistics discrepancy caused by potential domain shifts during testing. In this paper, we improve the network generalization ability by modeling domain shifts with uncertainty (DSU), i.e., characterizing the feature statistics as uncertain distributions during training. Specifically, we hypothesize that the feature statistic, after considering the potential uncertainties, follows a multivariate Gaussian distribution. During inference, we propose an instance-wise adaptation strategy that can adaptively deal with the unforeseeable shift and further enhance the generalization ability of the trained model with negligible additional cost. We also conduct theoretical analysis on the aspects of generalization error bound and the implicit regularization effect, showing the efficacy of our method. Extensive experiments demonstrate that our method consistently improves the network generalization ability on multiple vision tasks, including image classification, semantic segmentation, instance retrieval, and pose estimation. Our methods are simple yet effective and can be readily integrated into networks without additional trainable parameters or loss constraints. Code will be released in <a class="link-external link-https" href="https://github.com/lixiaotong97/DSU" rel="external noopener nofollow">this https URL</a>.

Modeling Uncertain Feature Representation for Domain Generalization

Uncertainty Modeling for Out-of-Distribution Generalization

Domain Generalization for Vision-based Driving Trajectory Generation

Invariance Learning Under Uncertainty for Single Domain Generalization Person Re-Identification

A Simple Feature Augmentation for Domain Generalization

Domain Generalization-Aware Uncertainty Introspective Learning for 3D Point Clouds Segmentation

Towards Unified and Effective Domain Generalization

Enlarging Feature Support Overlap for Domain Generalization

Domain Generalization Via Frequency-domain-based Feature Disentanglement and Interaction

From Deterministic to Probabilistic: A Novel Perspective on Domain Generalization for Medical Image Segmentation

Domain Generalization for Medical Imaging Classification with Linear-Dependency Regularization

Diverse Target and Contribution Scheduling for Domain Generalization

Learning Transferrable and Interpretable Representations for Domain Generalization

Model-Based Domain Generalization

Smooth-Guided Implicit Data Augmentation for Domain Generalization

Domain generalization based on domain-specific adversarial learning

Certifying Better Robust Generalization for Unsupervised Domain Adaptation

Provable Domain Generalization via Invariant-Feature Subspace Recovery

Gated Domain Units for Multi-source Domain Generalization

Domain Generalization with Small Data

DIRL: Domain-Invariant Representation Learning for Generalizable Semantic Segmentation