Abstract:While commodity GPUs provide a continuously growing range of features and sophisticated methods for accelerating compute jobs, many state-of-the-art solutions for point cloud rendering still rely on the provided point primitives (GL_POINTS, POINTLIST, ...) of graphics APIs for image synthesis. In this paper, we present several compute-based point cloud rendering approaches that outperform the hardware pipeline by up to an order of magnitude and achieve significantly better frame times than previous compute-based methods. Beyond basic closest-point rendering, we also introduce a fast, high-quality variant to reduce aliasing. We present and evaluate several variants of our proposed methods with different flavors of optimization, in order to ensure their applicability and achieve optimal performance on a range of platforms and architectures with varying support for novel GPU hardware features. During our experiments, the observed peak performance was reached rendering 796 million points (12.7GB) at rates of 62 to 64 frames per second (50 billion points per second, 802GB/s) on an RTX 3090 without the use of level-of-detail structures. We further introduce an optimized vertex order for point clouds to boost the efficiency of GL_POINTS by a factor of 5x in cases where hardware rendering is compulsory. We compare different orderings and show that Morton sorted buffers are faster for some viewpoints, while shuffled vertex buffers are faster in others. In contrast, combining both approaches by first sorting according to Morton-code and shuffling the resulting sequence in batches of 128 points leads to a vertex buffer layout with high rendering performance and low sensitivity to viewpoint changes.

Real-Time Decompression and Rasterization of Massive Point Clouds

Progressive Real‐Time Rendering of One Billion Points Without Hierarchical Acceleration Structures

A Novel Pointcloud-Based Isosurface Extraction

Balancing Cpu And Gpu: Real-Time Visualization Of Large Scale 3d Scanning Models

High Quality Real-Time Rendering of Large Scale Point Model

Bits-to-Photon: End-to-End Learned Scalable Point Cloud Compression for Direct Rendering

Real-time Render Large Amount of LIDAR Point Clouds Data

Connectivity-Based Segmentation for GPU-Accelerated Mesh Decompression

A GPU-Enabled Real-Time Framework for Compressing and Rendering Volumetric Videos

A Low-Latency Framework with Algorithm-Hardware Co-Optimization for 3-D Point Cloud

NARVis: Neural Accelerated Rendering for Real-Time Scientific Point Cloud Visualization

Rendering Point Clouds with Compute Shaders and Vertex Order Optimization

Compressed Geometric Arrays for Point Cloud Processing

Real-Time Spatio-Temporal LiDAR Point Cloud Compression

QuickFPS: Architecture and Algorithm Co-Design for Farthest Point Sampling in Large-Scale Point Clouds

Low Latency Point Cloud Rendering with Learned Splatting

Fast Compressed Segmentation Volumes for Scientific Visualization

Sparse Representation based Deep Residual Geometry Compression Network for Large-scale Point Clouds

A Method to Order Point Clouds for Visualization on the Ray Tracing Pipeline

Fast occlusion-based point cloud exploration

Pointsoup: High-Performance and Extremely Low-Decoding-Latency Learned Geometry Codec for Large-Scale Point Cloud Scenes