Abstract:Three-dimensional (3D) point clouds have a wide range of applications in the field of 3D vision. The quality of the acquired point cloud data considerably impacts the subsequent work of point cloud processing. Due to the sparsity and irregularity of point cloud data, processing point cloud data has always been challenging. However, existing deep learning-based point cloud dense reconstruction methods suffer from excessive smoothing of reconstruction results and too many outliers. The reason for this is that it is not possible to extract features for local and global features at different scales and provide different levels of attention to different regions in order to obtain long-distance dependence for dense reconstruction. In this paper, we use a parallel multi-scale feature extraction module based on graph convolution and an upsampling method with an added multi-head attention mechanism to process sparse and irregular point cloud data to obtain extended point clouds. Specifically, a point cloud training patch with 256 points is inputted. The PMS module uses three residual connections in the multi-scale feature extraction stage. Each PMS module consists of three parallel DenseGCN modules with different size convolution kernels and different averaging pooling sizes. The local and global feature information of the augmented receptive field is extracted efficiently. The scale information is obtained by averaging the different pooled augmented receptive fields. The scale information was obtained using the different average pooled augmented receptive fields. The upsampling stage uses an upsampling rate of r=4, The self-attentive features with a different focus on different point cloud data regions obtained by fusing different weights make the feature representation more diverse. This operation avoids the bias of one attention, and each focuses on extracting valuable fine-grained feature information. Finally, the coordinate reconstruction module obtains 1024 dense point cloud data. Experiments show that the proposed method demonstrates good evaluation metrics and performance and is able to obtain better visual quality. The problems of over-smoothing and excessive outliers are effectively mitigated, and the obtained sparse point cloud is more dense.

SSPU-Net: A Structure Sensitive Point Cloud Upsampling Network with Multi-Scale Spatial Refinement

Point Cloud Upsampling via Cascaded Refinement Network

Point Cloud Upsampling Algorithm: A Systematic Review

SPU-Net: Self-Supervised Point Cloud Upsampling by Coarse-to-Fine Reconstruction with Self-Projection Optimization

Refine-PU: A Graph Convolutional Point Cloud Upsampling Network using Spatial Refinement

APUNet: Attention-guided Upsampling Network for Sparse and Non-Uniform Point Cloud

Semantic Point Cloud Upsampling

Point Cloud Upsampling Via Disentangled Refinement

PU-Net: Point Cloud Upsampling Network

Sparse 3D Point Cloud Parallel Multi-Scale Feature Extraction and Dense Reconstruction with Multi-Headed Attentional Upsampling

PU-GAT: Point Cloud Upsampling with Graph Attention Network

Upu-Snet: Siamese Network for Unsupervised Point Cloud Upsampling Based on Spatial-Aware Transformers

SSPU-Net: Self-Supervised Point Cloud Upsampling via Differentiable Rendering

BIMS-PU: Bi-Directional and Multi-Scale Point Cloud Upsampling

Sequential Point Cloud Upsampling by Exploiting Multi-Scale Temporal Dependency

Point cloud upsampling via a coarse-to-fine network with transformer-encoder

PU-CTG: A Point Cloud Upsampling Network Using Transformer Fusion and GRU Correction

Density-imbalance-eased LiDAR Point Cloud Upsampling via Feature Consistency Learning

PUI-Net: A Point Cloud Upsampling and Inpainting Network

A Two-Stage Transformer-Based Point Cloud Upsampling

Data-driven Upsampling of Point Clouds