Cycle4Completion: Unpaired Point Cloud Completion Using Cycle Transformation with Missing Region Coding

Xin Wen,Zhizhong Han,Yan-Pei Cao,Pengfei Wan,Wen Zheng,Yu-Shen Liu
DOI: https://doi.org/10.1109/cvpr46437.2021.01288
2021-01-01
Computer Vision and Pattern Recognition
Abstract:In this paper, we present a novel unpaired point cloud completion network, named Cycle4Completion, to infer the complete geometries from a partial 3D object. Previous unpaired completion methods merely focus on the learning of geometric correspondence from incomplete shapes to complete shapes, and ignore the learning in the reverse direction, which makes them suffer from low completion accuracy due to the limited 3D shape understanding ability. To address this problem, we propose two simultaneous cycle transformations between the latent spaces of complete shapes and incomplete ones. Specifically, the first cycle transforms shapes from incomplete domain to complete domain, and then projects them back to the incomplete domain. This process learns the geometric characteristic of complete shapes, and maintains the shape consistency between the complete prediction and the incomplete input. Similarly, the inverse cycle transformation starts from complete domain to incomplete domain, and goes back to complete domain to learn the characteristic of incomplete shapes. We experimentally show that our model with the learned bidirectional geometry correspondence outperforms state-of-the-art unpaired completion methods. Code will be available at https://github.com/diviswen/Cycle4Completion.
What problem does this paper attempt to address?