Abstract:Point clouds captured by scanning devices are often incomplete due to occlusion. To overcome this limitation, point cloud completion methods have been developed to predict the complete shape of an object based on its partial input. These methods can be broadly classified as supervised or unsupervised. However, both categories require a large number of 3D complete point clouds, which may be difficult to capture. In this paper, we propose Cross-PCC, an unsupervised point cloud completion method without requiring any 3D complete point clouds. We only utilize 2D images of the complete objects, which are easier to capture than 3D complete and clean point clouds. Specifically, to take advantage of the complementary information from 2D images, we use a single-view RGB image to extract 2D features and design a fusion module to fuse the 2D and 3D features extracted from the partial point cloud. To guide the shape of predicted point clouds, we project the predicted points of the object to the 2D plane and use the foreground pixels of its silhouette maps to constrain the position of the projected points. To reduce the outliers of the predicted point clouds, we propose a view calibrator to move the points projected to the background into the foreground by the single-view silhouette image. To the best of our knowledge, our approach is the first point cloud completion method that does not require any 3D supervision. The experimental results of our method are superior to those of the state-of-the-art unsupervised methods by a large margin. Moreover, our method even achieves comparable performance to some supervised methods. We will make the source code publicly available at <a class="link-external link-https" href="https://github.com/ltwu6/cross-pcc" rel="external noopener nofollow">this https URL</a>.

Uncertainty Estimation for 3D Dense Prediction via Cross-Point Embeddings

A Unified BEV Model for Joint Learning of 3D Local Features and Overlap Estimation.

Depth Estimation from Monocular Images Using Dilated Convolution and Uncertainty Learning.

Stein ICP for Uncertainty Estimation in Point Cloud Matching

Feature Decoupling and Uncertainty Estimation for 3D Object Detection

Neighborhood Spatial Aggregation Based Efficient Uncertainty Estimation for Point Cloud Semantic Segmentation

Uncertainty Estimation for 3D Object Detection via Evidential Learning

A New Approach to 3D ICP Covariance Estimation

Uncertainty Guided Multi-View Stereo Network for Depth Estimation

Hierarchical Uncertainty Estimation for Medical Image Segmentation Networks

Uncertainty-Aware Multi-modal Learning via Cross-Modal Random Network Prediction.

Leveraging Single-View Images for Unsupervised 3D Point Cloud Completion

Uncertainty-Aware Self-Improving Framework for Depth Estimation

Spatial Uncertainty Model Based on Scale-Space for RGBD-SLAM System

Measuring and Modeling Uncertainty Degree for Monocular Depth Estimation

UTOPIC: Uncertainty-aware Overlap Prediction Network for Partial Point Cloud Registration

Efficient Multi-task Uncertainties for Joint Semantic Segmentation and Monocular Depth Estimation

UNCERTAINTY ESTIMATION FOR END-TO-END LEARNED DENSE STEREO MATCHING VIA PROBABILISTIC DEEP LEARNING

Confidence-aware 3D Gaze Estimation and Evaluation Metric

Uncertainty-guided Optimal Transport in Depth Supervised Sparse-View 3D Gaussian

Learning 3D Dense Correspondence via Canonical Point Autoencoder