Abstract:Semantic segmentation of urban scenes aims to identify and segment persons,obstacles,roads,signs and other elements from the image,and provide information of free space on the road for vehicles.It is one of the key technologies of automatic dri-ving.High performance semantic segmentation systems rely heavily on a large number of real annotation data required for trai-ning.However,labeling each pixel in the image is costly and often difficult to achieve.One way is to collect photo-realistic synthe-tic data from video games,where pixel-level annotation can be automatically generated at a low cost,to train the machine learning model to segment the images in the real world,which corresponds to domain adaptation.Different from the current mainstream semantic segmentation domain adaptation methods based on Vapnik-Chervonenkis dimension theory or Rademacher complexity theory,our method is inspired by the target domain Gibbs risk upper bound compatible with pseudo labels based on PAC-Bayes theory,and considers the average situation of the hypothetical space rather than the worst situation,so as to avoid excessively constraining the domain discrepancy in the latent space which leads to the problem that the upper bound of target domain genera-lization error cannot be estimated and optimized effectively.Under the guidance of the above ideas,this paper proposes a varia-tional inference method for semantic segmentation adaptation(VISA).The dropout variational family is used for variational infe-rence.While solving the ideal posterior distribution in the hypothesis space,an approximate Bayes classifier can be quickly obtained,and the estimation of the upper bound of risk is more accurate by minimizing the entropy of the target domain and filtering pixels.Experiments show that the mean intersection over the union(mIoU) of VISA is 0.5% ~ 6.6% higher than that of baseline methods,and has high accuracy in pedestrian,vehicle and other urban scene elements.

Closing the gap in domain adaptation for semantic segmentation: a time-aware method

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Shift in Semantic Segmentation

Partial Domain Adaptation on Semantic Segmentation

Iterative Loop Method Combining Active and Semi-Supervised Learning for Domain Adaptive Semantic Segmentation

Threshold-adaptive Unsupervised Focal Loss for Domain Adaptation of Semantic Segmentation

The Last Mile to Supervised Performance: Semi-Supervised Domain Adaptation for Semantic Segmentation

Exploiting Semantics in Adversarial Training for Image-Level Domain Adaptation

Regularizing Proxies with Multi-Adversarial Training for Unsupervised Domain-Adaptive Semantic Segmentation.

Pixel-Level Cycle Association: A New Perspective for Domain Adaptive Semantic Segmentation

Domain Adaptive Semantic Segmentation with Self-Supervised Depth Estimation

Alleviating Semantic-level Shift: A Semi-supervised Domain Adaptation Method for Semantic Segmentation

Variational Domain Adaptation Driven Semantic Segmentation of Urban Scenes

Uncertainty-weighted prototype active learning in domain adaptive semantic segmentation

Differential Treatment for Stuff and Things: A Simple Unsupervised Domain Adaptation Method for Semantic Segmentation

SS-ADA: A Semi-Supervised Active Domain Adaptation Framework for Semantic Segmentation

Divide, Ensemble and Conquer: The Last Mile on Unsupervised Domain Adaptation for Semantic Segmentation

Rethinking Unsupervised Domain Adaptation for Semantic Segmentation

Class Balanced Dynamic Acquisition for Domain Adaptive Semantic Segmentation using Active Learning

Multi-source Domain Adaptation for Semantic Segmentation

Informative Data Mining for One-Shot Cross-Domain Semantic Segmentation

Bidirectional Self-Training with Multiple Anisotropic Prototypes for Domain Adaptive Semantic Segmentation