Abstract:Three-dimensional (3D) point clouds have a wide range of applications in the field of 3D vision. The quality of the acquired point cloud data considerably impacts the subsequent work of point cloud processing. Due to the sparsity and irregularity of point cloud data, processing point cloud data has always been challenging. However, existing deep learning-based point cloud dense reconstruction methods suffer from excessive smoothing of reconstruction results and too many outliers. The reason for this is that it is not possible to extract features for local and global features at different scales and provide different levels of attention to different regions in order to obtain long-distance dependence for dense reconstruction. In this paper, we use a parallel multi-scale feature extraction module based on graph convolution and an upsampling method with an added multi-head attention mechanism to process sparse and irregular point cloud data to obtain extended point clouds. Specifically, a point cloud training patch with 256 points is inputted. The PMS module uses three residual connections in the multi-scale feature extraction stage. Each PMS module consists of three parallel DenseGCN modules with different size convolution kernels and different averaging pooling sizes. The local and global feature information of the augmented receptive field is extracted efficiently. The scale information is obtained by averaging the different pooled augmented receptive fields. The scale information was obtained using the different average pooled augmented receptive fields. The upsampling stage uses an upsampling rate of r=4, The self-attentive features with a different focus on different point cloud data regions obtained by fusing different weights make the feature representation more diverse. This operation avoids the bias of one attention, and each focuses on extracting valuable fine-grained feature information. Finally, the coordinate reconstruction module obtains 1024 dense point cloud data. Experiments show that the proposed method demonstrates good evaluation metrics and performance and is able to obtain better visual quality. The problems of over-smoothing and excessive outliers are effectively mitigated, and the obtained sparse point cloud is more dense.

Point Cloud Upsampling with Geometric Algebra Driven Inverse Heat Dissipation

Point Cloud Upsampling Algorithm: A Systematic Review

Data-driven Upsampling of Point Clouds

Research on deep learning algorithms for point cloud upsampling

Grad-PU: Arbitrary-Scale Point Cloud Upsampling via Gradient Descent with Learned Distance Functions

Point Cloud Upsampling Via Disentangled Refinement

Optimization of Octree-Based Adaptive Geometry Quantization Via Up-Sampling for G-PCC

A Conditional Denoising Diffusion Probabilistic Model for Point Cloud Upsampling

Point Cloud Upsampling via Cascaded Refinement Network

Sparse 3D Point Cloud Parallel Multi-Scale Feature Extraction and Dense Reconstruction with Multi-Headed Attentional Upsampling

Deep Geometry Post-Processing for Decompressed Point Clouds.

PU-Net: Point Cloud Upsampling Network

Point Cloud Geometry Prediction Across Spatial Scale Using Deep Learning

Point Cloud Upsampling with Dynamic Graph Scattering Transform

HFCI-PU: High-Frequency Compensation Interpolation Network for Point Cloud Upsampling

Frequency-Selective Geometry Upsampling of Point Clouds

Neural Points: Point Cloud Representation with Neural Fields for Arbitrary Upsampling

Arbitrary-Scale Point Cloud Upsampling by Voxel-Based Network with Latent Geometric-Consistent Learning

Arbitrary point cloud upsampling via Dual Back-Projection Network

PU-Flow: a Point Cloud Upsampling Network with Normalizing Flows

Geometric Prior Based Deep Human Point Cloud Geometry Compression