Unsupervised Domain Adaptive Point Cloud Semantic Segmentation.

Yikai Bian,Jin Xie,Jianjun Qian
DOI: https://doi.org/10.1007/978-3-031-02375-0_21
2021-01-01
Abstract:Domain adaptation for point cloud semantic segmentation is important since manually labeling point cloud datasets for each domain are expensive and time-consuming. In this paper, in order to transfer prior knowledge from the labeled source domain to the unlabeled target domain, we propose a novel domain consistency framework for unsupervised domain adaptive point cloud semantic segmentation. Specifically, in our framework, we construct a multi-level feature consistency model to generate the high quality pseudo labels for the unlabeled target domain. In the constructed feature consistency model, we encourage the labels of feature maps of point clouds at different levels to be as consistent as possible. Based on the generated features with rich geometric structure information, we furthermore impose a feature consistency constraint on the feature memory bank of the source domain and target features to develop a feature bank based cycle association model. Thus, benefiting from the developed cycle association model, we can alleviate the domain gap and learn discriminative features of point clouds for semantic segmentation in the target domain. Extensive evaluations on different outdoor scenarios ("vKITTI to SemanticPOSS" and "SynthCity to SemanticPOSS") and indoor scenarios ("S3DIS to ScanNet" ) show that our framework achieves state-of-the-art performance.
What problem does this paper attempt to address?