Abstract:Three-dimensional (3D) point clouds have a wide range of applications in the field of 3D vision. The quality of the acquired point cloud data considerably impacts the subsequent work of point cloud processing. Due to the sparsity and irregularity of point cloud data, processing point cloud data has always been challenging. However, existing deep learning-based point cloud dense reconstruction methods suffer from excessive smoothing of reconstruction results and too many outliers. The reason for this is that it is not possible to extract features for local and global features at different scales and provide different levels of attention to different regions in order to obtain long-distance dependence for dense reconstruction. In this paper, we use a parallel multi-scale feature extraction module based on graph convolution and an upsampling method with an added multi-head attention mechanism to process sparse and irregular point cloud data to obtain extended point clouds. Specifically, a point cloud training patch with 256 points is inputted. The PMS module uses three residual connections in the multi-scale feature extraction stage. Each PMS module consists of three parallel DenseGCN modules with different size convolution kernels and different averaging pooling sizes. The local and global feature information of the augmented receptive field is extracted efficiently. The scale information is obtained by averaging the different pooled augmented receptive fields. The scale information was obtained using the different average pooled augmented receptive fields. The upsampling stage uses an upsampling rate of r=4, The self-attentive features with a different focus on different point cloud data regions obtained by fusing different weights make the feature representation more diverse. This operation avoids the bias of one attention, and each focuses on extracting valuable fine-grained feature information. Finally, the coordinate reconstruction module obtains 1024 dense point cloud data. Experiments show that the proposed method demonstrates good evaluation metrics and performance and is able to obtain better visual quality. The problems of over-smoothing and excessive outliers are effectively mitigated, and the obtained sparse point cloud is more dense.

Point cloud upsampling via a coarse-to-fine network with transformer-encoder

Dual-scale Point Cloud Completion Network Based on High-Frequency Feature Fusion

Fast Point Cloud Sampling Network.

Point Cloud Completion Cascade Optimization Network Based on Feature Fusion

Point Cloud Upsampling via Cascaded Refinement Network

PU-CTG: A Point Cloud Upsampling Network Using Transformer Fusion and GRU Correction

PU-Transformer: Point Cloud Upsampling Transformer

PU-Net: Point Cloud Upsampling Network

Neural Points: Point Cloud Representation with Neural Fields for Arbitrary Upsampling

Transformer-based Point Cloud Generation Network

Transformer and Upsampling-Based Point Cloud Compression

Point Cloud Upsampling Algorithm: A Systematic Review

SPU-Net: Self-Supervised Point Cloud Upsampling by Coarse-to-Fine Reconstruction with Self-Projection Optimization

CRA-PCN: Point Cloud Completion with Intra- and Inter-level Cross-Resolution Transformers

A Coarse-to-Fine Transformer-Based Network for 3D Reconstruction from Non-Overlapping Multi-View Images

Data-driven Upsampling of Point Clouds

HFF-Net: Hierarchical Feature Fusion Network for Point Cloud Generation with Point Transformers

Grad-PU: Arbitrary-Scale Point Cloud Upsampling via Gradient Descent with Learned Distance Functions

CU-Net: Real-Time High-Fidelity Color Upsampling for Point Clouds

Sparse 3D Point Cloud Parallel Multi-Scale Feature Extraction and Dense Reconstruction with Multi-Headed Attentional Upsampling

Deep Point Cloud Reconstruction