Abstract:Rendering and reconstruction are long-standing topics in computer vision and graphics. Achieving both high rendering quality and accurate geometry is a challenge. Recent advancements in 3D Gaussian Splatting (3DGS) have enabled high-fidelity novel view synthesis at real-time speeds. However, the noisy and discrete nature of 3D Gaussian primitives hinders accurate surface estimation. Previous attempts to regularize 3D Gaussian normals often degrade rendering quality due to the fundamental disconnect between normal vectors and the rendering pipeline in 3DGS-based methods. Therefore, we introduce Normal-GS, a novel approach that integrates normal vectors into the 3DGS rendering pipeline. The core idea is to model the interaction between normals and incident lighting using the physically-based rendering equation. Our approach re-parameterizes surface colors as the product of normals and a designed Integrated Directional Illumination Vector (IDIV). To optimize memory usage and simplify optimization, we employ an anchor-based 3DGS to implicitly encode locally-shared IDIVs. Additionally, Normal-GS leverages optimized normals and Integrated Directional Encoding (IDE) to accurately model specular effects, enhancing both rendering quality and surface normal precision. Extensive experiments demonstrate that Normal-GS achieves near state-of-the-art visual quality while obtaining accurate surface normals and preserving real-time rendering performance.

Rendering Thin Transparent Layers with Extended Normal Distribution Functions.

Algorithm for Displaying Surfaces from Volume Data

Real-time rendering of rough refraction

Real-time High-Quality Surface Rendering for Large Scale Particle-Based Fluids

Feature-Adaptive Rendering of Loop Subdivision Surfaces on Modern GPUs

Neural Histogram‐Based Glint Rendering of Surfaces With Spatially Varying Roughness

Realtime Rendering Glossy to Glossy Reflections in Screen Space

Rendering Discrete Participating Media with Geometrical Optics Approximation

A Practical Path Guiding Method for Participating Media

Rendering Discrete Participating Media Using Geometrical Optics Approximation

Real-time Rendering of Refracting Transmissive Objects with Multi-Scale Rough Surfaces

An approximate image-space approach for real-time rendering of deformable translucent objects

Modeling and Rendering of Heterogeneous Translucent Materials Using the Diffusion Equation

Real-Time Multi-scale Refraction under All-Frequency Environmental Lighting

Multirate Shading with Piecewise Interpolatory Approximation

Real-Time Homogenous Translucent Material Editing

Normal-GS: 3D Gaussian Splatting with Normal-Involved Rendering

Constant-Cost Spatio-Angular Prefiltering of Glinty Appearance Using Tensor Decomposition

Real-Time Rendering of Layered Materials with Linearly Filterable Reflectance Model.

Feature Adaptive Rendering of Loop Subdivision Surfaces on GPU

Efficient Density Control for 3D Gaussian Splatting