Abstract:Real-scanned point clouds are often incomplete due to viewpoint, occlusion, and noise, which hampers 3D geometric modeling and perception. Existing point cloud completion methods tend to generate global shape skeletons and hence lack fine local details. Furthermore, they mostly learn a deterministic partial-to-complete mapping, but overlook structural relations in man-made objects. To tackle these challenges, this paper proposes a variational framework, Variational Relational point Completion Network (VRCNet) with two appealing properties: 1) Probabilistic Modeling. In particular, we propose a dual-path architecture to enable principled probabilistic modeling across partial and complete clouds. One path consumes complete point clouds for reconstruction by learning a point VAE. The other path generates complete shapes for partial point clouds, whose embedded distribution is guided by distribution obtained from the reconstruction path during training. 2) Relational Enhancement. Specifically, we carefully design point self-attention kernel and point selective kernel module to exploit relational point features, which refines local shape details conditioned on the coarse completion. In addition, we contribute multi-view partial point cloud datasets (MVP and MVP-40 dataset) containing over 200,000 high-quality scans, which render partial 3D shapes from 26 uniformly distributed camera poses for each 3D CAD model. Extensive experiments demonstrate that VRCNet outperforms state-of-the-art methods on all standard point cloud completion benchmarks. Notably, VRCNet shows great generalizability and robustness on real-world point cloud scans. Moreover, we can achieve robust 3D classification for partial point clouds with the help of VRCNet, which can highly increase classification accuracy.

Vehicle Completion in Traffic Scene Using 3D LiDAR Point Cloud Data

VPC-Net: Completion of 3D Vehicles from MLS Point Clouds

Adaptive Recurrent Forward Network for Dense Point Cloud Completion

3D LiDAR Map Compression Using Deep Neural Network.

COMPLETION OF SPARSE AND PARTIAL POINT CLOUDS OF VEHICLES USING A NOVEL END-TO-END NETWORK

Up-to-Down Network: Fusing Multi-Scale Context for 3D Semantic Scene Completion

Dual-scale Point Cloud Completion Network Based on High-Frequency Feature Fusion

Self-supervised Point Cloud Completion on Real Traffic Scenes via Scene-concerned Bottom-up Mechanism

3D Vehicle Detection Using Cheap LiDAR and Camera Sensors.

Research on Multi-modal Point Cloud Completion Task

SegVoxelNet: Exploring Semantic Context and Depth-aware Features for 3D Vehicle Detection from Point Cloud

Gap Completion in Point Cloud Scene occluded by Vehicles using SGC-Net

Voxel- and Bird's-Eye-View-Based Semantic Scene Completion for LiDAR Point Clouds

3D Fully Convolutional Network for Vehicle Detection in Point Cloud

Semantic Segmentation-assisted Scene Completion for LiDAR Point Clouds

A LiDAR Point Cloud Generator: from a Virtual World to Autonomous Driving

3D Detection for Occluded Vehicles From Point Clouds

3D Point Cloud Processing and Learning for Autonomous Driving

Variational Relational Point Completion Network for Robust 3D Classification

3D Object Detection and High-Resolution Traffic Parameters Extraction Using Low-Resolution LiDAR Data