Abstract:Neural Radiance Fields (NeRFs) have demonstrated remarkable proficiency in synthesizing photorealistic images of large-scale scenes. However, they are often plagued by a loss of fine details and long rendering durations. 3D Gaussian Splatting has recently been introduced as a potent alternative, achieving both high-fidelity visual results and accelerated rendering performance. Nonetheless, scaling 3D Gaussian Splatting is fraught with challenges. Specifically, large-scale scenes grapples with the integration of objects across multiple scales and disparate viewpoints, which often leads to compromised efficacy as the Gaussians need to balance between detail levels. Furthermore, the generation of initialization points via COLMAP from large-scale dataset is both computationally demanding and prone to incomplete reconstructions. To address these challenges, we present Pyramidal 3D Gaussian Splatting (PyGS) with NeRF Initialization. Our approach represent the scene with a hierarchical assembly of Gaussians arranged in a pyramidal fashion. The top level of the pyramid is composed of a few large Gaussians, while each subsequent layer accommodates a denser collection of smaller Gaussians. We effectively initialize these pyramidal Gaussians through sampling a rapidly trained grid-based NeRF at various frequencies. We group these pyramidal Gaussians into clusters and use a compact weighting network to dynamically determine the influence of each pyramid level of each cluster considering camera viewpoint during rendering. Our method achieves a significant performance leap across multiple large-scale datasets and attains a rendering time that is over 400 times faster than current state-of-the-art approaches.

Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussians

Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussians

Efficient Density Control for 3D Gaussian Splatting

CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussians

GS‐Octree: Octree‐based 3D Gaussian Splatting for Robust Object‐level 3D Reconstruction Under Strong Lighting

A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets

Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering

GS-Octree: Octree-based 3D Gaussian Splatting for Robust Object-level 3D Reconstruction Under Strong Lighting

4D Gaussian Splatting for Real-Time Dynamic Scene Rendering

6DGS: Enhanced Direction-Aware Gaussian Splatting for Volumetric Rendering

PyGS: Large-scale Scene Representation with Pyramidal 3D Gaussian Splatting

AbsGS: Recovering Fine Details for 3D Gaussian Splatting

EfficientGS: Streamlining Gaussian Splatting for Large-Scale High-Resolution Scene Representation

DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalization

Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splatting

PEP-GS: Perceptually-Enhanced Precise Structured 3D Gaussians for View-Adaptive Rendering

Unbounded-GS: Extending 3D Gaussian Splatting with Hybrid Representation for Unbounded Large-Scale Scene Reconstruction

DOGS: Distributed-Oriented Gaussian Splatting for Large-Scale 3D Reconstruction Via Gaussian Consensus

GaussianPro: 3D Gaussian Splatting with Progressive Propagation