Abstract:Domain adaptation aims to reduce the model degradation on the target domain caused by the domain shift between the source and target domains. Although encouraging performance has been achieved by combining cognitive learning with the self-training paradigm, they suffer from ambiguous scenarios caused by scale, illumination, or overlapping when deploying deterministic embedding. To address these issues, we propose probabilistic proto-typical pixel contrast (PPPC), a universal adaptation framework that models each pixel embedding as a probability via multivariate Gaussian distribution to fully exploit the uncertainty within them, eventually improving the representation quality of the model. In addition, we derive prototypes from probability estimation posterior probability estimation which helps to push the decision boundary away from the ambiguity points. Moreover, we employ an efficient method to compute similarity between distributions, eliminating the need for sampling and reparameterization, thereby significantly reducing computational overhead. Further, we dynamically select the ambiguous crops at the image level to enlarge the number of boundary points involved in contrastive learning, which benefits the establishment of precise distributions for each category. Extensive experimentation demonstrates that PPPC not only helps to address ambiguity at the pixel level, yielding discriminative representations but also achieves significant improvements in both synthetic-to-real and day-to-night adaptation tasks. It surpasses the previous state-of-the-art (SOTA) by +5.2% mIoU in the most challenging daytime-to-nighttime adaptation scenario, exhibiting stronger generalization on other unseen datasets. The code and models are available at <a class="link-external link-https" href="https://github.com/DarlingInTheSV/Probabilistic-Prototypical-Pixel-Contrast" rel="external noopener nofollow">this https URL</a>.

Pixel-Level Cycle Association: A New Perspective for Domain Adaptive Semantic Segmentation

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Shift in Semantic Segmentation

When Masked Image Modeling Meets Source-free Unsupervised Domain Adaptation: Dual-Level Masked Network for Semantic Segmentation

Reducing Semantic Ambiguity In Domain Adaptive Semantic Segmentation Via Probabilistic Prototypical Pixel Contrast

Unsupervised Domain Adaptive Point Cloud Semantic Segmentation.

Cycle and Self-Supervised Consistency Training for Adapting Semantic Segmentation of Aerial Images

Exploring High-Correlation Source Domain Information for Multi-Source Domain Adaptation in Semantic Segmentation

Alleviating Semantic-level Shift: A Semi-supervised Domain Adaptation Method for Semantic Segmentation

Partial Domain Adaptation on Semantic Segmentation

Domain Adaptive Semantic Segmentation with Self-Supervised Depth Estimation

A Domain Adaptive Semantic Segmentation Method Using Contrastive Learning and Data Augmentation

Affinity Space Adaptation for Semantic Segmentation Across Domains

Towards Source-free Domain Adaptive Semantic Segmentation via Importance-aware and Prototype-contrast Learning

Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentation

Unsupervised Domain Adaptive Image Semantic Segmentation Based on Convolutional Fine-Grained Discriminant and Entropy Minimization

Semantic-Aware Domain Generalized Segmentation.

Domain Adaptive Semantic Segmentation Through Structure Enhancement

Iterative Loop Method Combining Active and Semi-Supervised Learning for Domain Adaptive Semantic Segmentation

Bidirectional Self-Training with Multiple Anisotropic Prototypes for Domain Adaptive Semantic Segmentation

Fully Convolutional Adaptation Networks for Semantic Segmentation

Contrast, Stylize and Adapt: Unsupervised Contrastive Learning Framework for Domain Adaptive Semantic Segmentation