Abstract:In real-world scenarios, scanned point clouds are often incomplete due to occlusion issues. The task of self-supervised point cloud completion involves reconstructing missing regions of these incomplete objects without the supervision of complete ground truth. Current self-supervised methods either rely on multiple views of partial observations for supervision or overlook the intrinsic geometric similarity that can be identified and utilized from the given partial point clouds. In this paper, we propose MAL-SPC, a framework that effectively leverages both object-level and category-specific geometric similarities to complete missing structures. Our MAL-SPC does not require any 3D complete supervision and only necessitates a single partial point cloud for each object. Specifically, we first introduce a Pattern Retrieval Network to retrieve similar position and curvature patterns between the partial input and the predicted shape, then leverage these similarities to densify and refine the reconstructed results. Additionally, we render the reconstructed complete shape into multi-view depth maps and design an adversarial learning module to learn the geometry of the target shape from category-specific single-view depth images. To achieve anisotropic rendering, we design a density-aware radius estimation algorithm to improve the quality of the rendered images. Our MAL-SPC yields the best results compared to current state-of-the-art methods.We will make the source code publicly available at \url{<a class="link-external link-https" href="https://github.com/ltwu6/malspc" rel="external noopener nofollow">this https URL</a>

What problem does this paper attempt to address?

The paper primarily addresses the issue of incomplete point cloud data obtained from real-world scans due to occlusions, proposing a method named MAL-SPC (Multi-view Adversarial Learning for Self-supervised Point Cloud Completion) to tackle the problem of 3D point cloud completion under self-supervision. Specifically, the main objectives of the paper are: - **Reconstruct missing parts**: Recover the missing parts from incomplete 3D point clouds without the supervision of complete ground truth data. - **Utilize local geometric similarity**: Reconstruct by identifying and leveraging the intrinsic geometric similarities and repetitiveness present in the given incomplete point clouds. - **Multi-view adversarial learning**: Employ multi-view depth maps for adversarial learning to enhance the realism and plausibility of the reconstructed shapes. The proposed MAL-SPC method includes the following key components: 1. **Pattern Retrieval Network**: Used to generate a preliminary complete point cloud and refine and enhance the reconstruction results by identifying correlations between local position and curvature patterns. 2. **Multi-view Adversarial Network**: Further improves the quality of reconstruction by learning shared geometric structures from data within the same category. Additionally, to improve the quality of rendered depth maps, a density-aware radius estimation algorithm is proposed to address anisotropic rendering issues. The contributions of the paper can be summarized as: - Introducing a Pattern Retrieval Network capable of leveraging object-level local geometric similarities and repetitiveness to effectively infer missing structures. - Developing a Multi-view Adversarial Network that uses the geometric similarities of specific categories to perfect missing shapes, and designing a density-aware radius estimation algorithm to enhance the quality of rendered images. In summary, this research proposes a novel self-supervised framework that not only can use a single incomplete point cloud as training input but also effectively leverages the geometric similarities within the point cloud and among objects of the same category to reconstruct missing parts, significantly improving the accuracy and quality of reconstruction.

Self-supervised 3D Point Cloud Completion via Multi-view Adversarial Learning

Point Cloud Domain Adaptation Via Masked Local 3D Structure Prediction

Masked Spatio-Temporal Structure Prediction for Self-supervised Learning on Point Cloud Videos

ACL-SPC: Adaptive Closed-Loop system for Self-Supervised Point Cloud Completion

Leveraging Single-View Images for Unsupervised 3D Point Cloud Completion

PointCG: Self-supervised Point Cloud Learning via Joint Completion and Generation

Point Cloud Self-supervised Learning via 3D to Multi-view Masked Autoencoder

Point Cloud Completion Via Self-projected View Augmentation and Implicit Field Constraint

Incomplete Laser 3D Point Cloud Classification and Completion Approach Based on Object Symmetry under Occlusion Conditions

P2C: Self-Supervised Point Cloud Completion from Single Partial Clouds

Multi-Angle Point Cloud-VAE: Unsupervised Feature Learning for 3D Point Clouds from Multiple Angles by Joint Self-Reconstruction and Half-to-Half Prediction

Self-supervised Latent Feature Learning for Partial Point Clouds Recognition

GS-PT: Exploiting 3D Gaussian Splatting for Comprehensive Point Cloud Understanding via Self-supervised Learning

Self‐supervised Depth Completion with Multi‐view Geometric Constraints

Unpaired Point Cloud Completion on Real Scans using Adversarial Training

Research on Multi-modal Point Cloud Completion Task

SPAC-Net: Rethinking Point Cloud Completion with Structural Prior

SVDFormer: Complementing Point Cloud via Self-view Augmentation and Self-structure Dual-generator

MM-Point: Multi-View Information-Enhanced Multi-Modal Self-Supervised 3D Point Cloud Understanding

Self-Supervised Learning of 3D Point Clouds: A Survey

CP-Net: Contour-Perturbed Reconstruction Network for Self-Supervised Point Cloud Learning