Abstract:Three-dimensional (3D) point clouds have a wide range of applications in the field of 3D vision. The quality of the acquired point cloud data considerably impacts the subsequent work of point cloud processing. Due to the sparsity and irregularity of point cloud data, processing point cloud data has always been challenging. However, existing deep learning-based point cloud dense reconstruction methods suffer from excessive smoothing of reconstruction results and too many outliers. The reason for this is that it is not possible to extract features for local and global features at different scales and provide different levels of attention to different regions in order to obtain long-distance dependence for dense reconstruction. In this paper, we use a parallel multi-scale feature extraction module based on graph convolution and an upsampling method with an added multi-head attention mechanism to process sparse and irregular point cloud data to obtain extended point clouds. Specifically, a point cloud training patch with 256 points is inputted. The PMS module uses three residual connections in the multi-scale feature extraction stage. Each PMS module consists of three parallel DenseGCN modules with different size convolution kernels and different averaging pooling sizes. The local and global feature information of the augmented receptive field is extracted efficiently. The scale information is obtained by averaging the different pooled augmented receptive fields. The scale information was obtained using the different average pooled augmented receptive fields. The upsampling stage uses an upsampling rate of r=4, The self-attentive features with a different focus on different point cloud data regions obtained by fusing different weights make the feature representation more diverse. This operation avoids the bias of one attention, and each focuses on extracting valuable fine-grained feature information. Finally, the coordinate reconstruction module obtains 1024 dense point cloud data. Experiments show that the proposed method demonstrates good evaluation metrics and performance and is able to obtain better visual quality. The problems of over-smoothing and excessive outliers are effectively mitigated, and the obtained sparse point cloud is more dense.

Fostering Sparsity in Sparse Convolution Networks for Efficient 3D Perception via Feature-Guidance

SSF: Sparse Point Cloud Object Detection Based on Self-Adaptive Voxel Encoding and Focal-Sparse Convolution

Spatial Pruned Sparse Convolution for Efficient 3D Object Detection

Sparse2Dense: Learning to Densify 3D Features for 3D Object Detection

SparseDet: Towards End-to-End 3D Object Detection

SparsePoint: Fully End-to-End Sparse 3D Object Detector

SparseLIF: High-Performance Sparse LiDAR-Camera Fusion for 3D Object Detection

VoxelFSD: voxel-based fully sparse detector with sparse convolution for 3D object detection

Fully Sparse Fusion for 3D Object Detection

Optimizing Sparse Convolution on GPUs with CUDA for 3D Point Cloud Processing in Embedded Systems

SparseFusion: Efficient Sparse Multi-Modal Fusion Framework for Long-Range 3D Perception

D3Feat: Joint Learning of Dense Detection and Description of 3D Local Features

Sparse Points to Dense Clouds: Enhancing 3D Detection with Limited LiDAR Data

Sparse 3D Point Cloud Parallel Multi-Scale Feature Extraction and Dense Reconstruction with Multi-Headed Attentional Upsampling

SP-Det: Leveraging Saliency Prediction for Voxel-Based 3D Object Detection in Sparse Point Cloud

Towards Efficient Multi-Modal 3D Object Detection: Homogeneous Sparse Fuse Network

SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videos

SparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-based 3D Object Detection

Live Semantic 3D Perception for Immersive Augmented Reality.

Real-Time 3D Object Detection From Point Cloud Through Foreground Segmentation

LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernels