Abstract:The task of point cloud upsampling aims to acquire dense and uniform point sets from sparse and irregular point sets. Although significant progress has been made with deep learning models, state-of-the-art methods require ground-truth dense point sets as the supervision, which makes them limited to be trained under synthetic paired training data and not suitable to be under real-scanned sparse data. However, it is expensive and tedious to obtain large numbers of paired sparse-dense point sets as supervision from real-scanned sparse data. To address this problem, we propose a self-supervised point cloud upsampling network, named SPU-Net, to capture the inherent upsampling patterns of points lying on the underlying object surface. Specifically, we propose a coarse-to-fine reconstruction framework, which contains two main components: point feature extraction and point feature expansion, respectively. In the point feature extraction, we integrate the self-attention module with the graph convolution network (GCN) to capture context information inside and among local regions simultaneously. In the point feature expansion, we introduce a hierarchically learnable folding strategy to generate upsampled point sets with learnable 2D grids. Moreover, to further optimize the noisy points in the generated point sets, we propose a novel self-projection optimization associated with uniform and reconstruction terms as a joint loss to facilitate the self-supervised point cloud upsampling. We conduct various experiments on both synthetic and real-scanned datasets, and the results demonstrate that we achieve comparable performances to state-of-the-art supervised methods.

URNet: High-quality single-pixel imaging with untrained reconstruction network

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Fast non-iterative blind restoration of hyperspectral images with PSFs

PIRN: Phase Invariant Reconstruction Network for Infrared Image Super-Resolution

Adaptive Super-Resolution Networks for Single-Pixel Imaging at Ultra-Low Sampling Rates

High fidelity single-pixel imaging

Underwater reflective single-pixel imaging based on parallel networks through strong scattering media under low sampling rates

High turbidity underwater single-pixel imaging based on Unet++ and attention mechanism at a low sampling

SPRNet: Single-Pixel Reconstruction for One-Stage Instance Segmentation

Single-Pixel Imaging Based on Deep Learning Enhanced Singular Value Decomposition

3D Single-pixel imaging with active sampling patterns and learning based reconstruction

Untrained Neural Nets for Snapshot Compressive Imaging: Theory and Algorithms

Generative adversarial network based single pixel imaging

Single pixel imaging via unsupervised deep compressive sensing with collaborative sparsity in discretized feature space

Dual-Scale Transformer for Large-Scale Single-Pixel Imaging

SPU-Net: Self-Supervised Point Cloud Upsampling by Coarse-to-Fine Reconstruction with Self-Projection Optimization

GAN-SRSPI: Super-Resolution Single-Pixel Imaging Using Generative Adversarial Networks

Single-Pixel Image Reconstruction Based on Block Compressive Sensing and Deep Learning

Underwater Object Detection and Reconstruction Based on Active Single-Pixel Imaging and Super-Resolution Convolutional Neural Network

Boosting Photon-Efficient Image Reconstruction With A Unified Deep Neural Network

Hyperspectral reconstruction from RGB images based on Res2-Unet deep learning network