Abstract:The task of point cloud upsampling aims to acquire dense and uniform point sets from sparse and irregular point sets. Although significant progress has been made with deep learning models, state-of-the-art methods require ground-truth dense point sets as the supervision, which makes them limited to be trained under synthetic paired training data and not suitable to be under real-scanned sparse data. However, it is expensive and tedious to obtain large numbers of paired sparse-dense point sets as supervision from real-scanned sparse data. To address this problem, we propose a self-supervised point cloud upsampling network, named SPU-Net, to capture the inherent upsampling patterns of points lying on the underlying object surface. Specifically, we propose a coarse-to-fine reconstruction framework, which contains two main components: point feature extraction and point feature expansion, respectively. In the point feature extraction, we integrate the self-attention module with the graph convolution network (GCN) to capture context information inside and among local regions simultaneously. In the point feature expansion, we introduce a hierarchically learnable folding strategy to generate upsampled point sets with learnable 2D grids. Moreover, to further optimize the noisy points in the generated point sets, we propose a novel self-projection optimization associated with uniform and reconstruction terms as a joint loss to facilitate the self-supervised point cloud upsampling. We conduct various experiments on both synthetic and real-scanned datasets, and the results demonstrate that we achieve comparable performances to state-of-the-art supervised methods.

PU-GAN: a Point Cloud Upsampling Adversarial Network

PUFA-GAN: A Frequency-Aware Generative Adversarial Network for 3D Point Cloud Upsampling

PU-Net: Point Cloud Upsampling Network

PU-GAT: Point Cloud Upsampling with Graph Attention Network

PU-CTG: A Point Cloud Upsampling Network Using Transformer Fusion and GRU Correction

Point Cloud Upsampling Algorithm: A Systematic Review

PU-MFA: Point Cloud Up-Sampling via Multi-Scale Features Attention

A Conditional Denoising Diffusion Probabilistic Model for Point Cloud Upsampling

Arbitrary point cloud upsampling via Dual Back-Projection Network

PU-Mask: 3D Point Cloud Upsampling via an Implicit Virtual Mask

SPU-Net: Self-Supervised Point Cloud Upsampling by Coarse-to-Fine Reconstruction with Self-Projection Optimization

iPUNet: Iterative Cross Field Guided Point Cloud Upsampling

Arbitrary-Scale Point Cloud Upsampling by Voxel-Based Network with Latent Geometric-Consistent Learning

PU-SDF: Arbitrary-Scale Uniformly Upsampling Point Clouds Via Signed Distance Functions

Point Cloud Upsampling via Cascaded Refinement Network

iPUNet:Iterative Cross Field Guided Point Cloud Upsampling

DPR-GAN: Dual-Stream Progressive Refinement for Adversarial 3D Point Cloud Generation

Latent-Space Laplacian Pyramids for Adversarial Representation Learning with 3D Point Clouds

SSPU-Net: Self-Supervised Point Cloud Upsampling via Differentiable Rendering

Parametric Surface Constrained Upsampler Network for Point Cloud

PU-Flow: a Point Cloud Upsampling Network with Normalizing Flows