Abstract:Though deep neural networks have achieved impressive success on various vision tasks, obvious performance degradation still exists when models are tested in out-of-distribution scenarios. In addressing this limitation, we ponder that the feature statistics (mean and standard deviation), which carry the domain characteristics of the training data, can be properly manipulated to improve the generalization ability of deep learning models. Existing methods commonly consider feature statistics as deterministic values measured from the learned features and do not explicitly model the uncertain statistics discrepancy caused by potential domain shifts during testing. In this paper, we improve the network generalization ability by modeling domain shifts with uncertainty (DSU), i.e., characterizing the feature statistics as uncertain distributions during training. Specifically, we hypothesize that the feature statistic, after considering the potential uncertainties, follows a multivariate Gaussian distribution. During inference, we propose an instance-wise adaptation strategy that can adaptively deal with the unforeseeable shift and further enhance the generalization ability of the trained model with negligible additional cost. We also conduct theoretical analysis on the aspects of generalization error bound and the implicit regularization effect, showing the efficacy of our method. Extensive experiments demonstrate that our method consistently improves the network generalization ability on multiple vision tasks, including image classification, semantic segmentation, instance retrieval, and pose estimation. Our methods are simple yet effective and can be readily integrated into networks without additional trainable parameters or loss constraints. Code will be released in <a class="link-external link-https" href="https://github.com/lixiaotong97/DSU" rel="external noopener nofollow">this https URL</a>.

Domain Generalization-Aware Uncertainty Introspective Learning for 3D Point Clouds Segmentation

Domain Adaptation on Point Clouds Via Geometry-Aware Implicits

SUG: Single-dataset Unified Generalization for 3D Point Cloud Classification

Learning Generalizable Part-based Feature Representation for 3D Point Clouds

Towards Open-Set Semantic Labeling in 3D Point Clouds : Analysis on the Unknown Class.

PointDGMamba: Domain Generalization of Point Cloud Classification via Generalized State Space Model

Geometry and Uncertainty-Aware 3D Point Cloud Class-Incremental Semantic Segmentation

Modeling Uncertain Feature Representation for Domain Generalization

DG-PIC: Domain Generalized Point-In-Context Learning for Point Cloud Understanding

Point-PRC: A Prompt Learning Based Regulation Framework for Generalizable Point Cloud Analysis

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

Push-and-Pull: A General Training Framework with Differential Augmentor for Domain Generalized Point Cloud Classification

Masked Local-Global Representation Learning for 3D Point Cloud Domain Adaptation

Learning to Adapt SAM for Segmenting Cross-domain Point Clouds

InvariantOODG: Learning Invariant Features of Point Clouds for Out-of-Distribution Generalization

An Unequal Deep Learning Approach for 3-D Point Cloud Segmentation

Domain Generalization of 3D Object Detection by Density-Resampling

Uncertainty Modeling for Out-of-Distribution Generalization

Panoptic Segmentation of 3D Point Clouds with Gaussian Mixture Model in Outdoor Scenes

Uni3DA: Universal 3D Domain Adaptation for Object Recognition

Self-supervised Domain Adaptation on Point Clouds Via Homomorphic Augmentation