Point Encoder GAN: A Deep Learning Model for 3D Point Cloud Inpainting.

Yikuan Yu,Zitian Huang,Fei Li,Haodong Zhang,Xinyi Le
DOI: https://doi.org/10.1016/j.neucom.2019.12.032
IF: 6
2020-01-01
Neurocomputing
Abstract:In this paper, we propose a Point Encoder GAN for 3D point cloud inpainting. Different from other 3D object inpainting networks, our network can process point cloud data directly without any labeling and assumption. We use a max-pooling layer to solve the unordered of point cloud during the learning procedure. We add two T -Nets (from PointNet) to the encoderdecoder pipeline, which can yield better feature representation of the input point cloud and a more suitable rotation angle of the output point cloud. We then propose a hybrid reconstruction loss function to measure the difference between the two sets of unordered data. Using small sample models on ModelNet40 only, the proposed Point Encoder GAN yields end-to-end inpainting results surprisingly. Experiment results have shown a high success rate. Several technical measures are used to identify the good qualities of our generated models.
What problem does this paper attempt to address?