Abstract:We propose progressive radiance distillation, an inverse rendering method that combines physically-based rendering with Gaussian-based radiance field rendering using a distillation progress map. Taking multi-view images as input, our method starts from a pre-trained radiance field guidance, and distills physically-based light and material parameters from the radiance field using an image-fitting process. The distillation progress map is initialized to a small value, which favors radiance field rendering. During early iterations when fitted light and material parameters are far from convergence, the radiance field fallback ensures the sanity of image loss gradients and avoids local minima that attracts under-fit states. As fitted parameters converge, the physical model gradually takes over and the distillation progress increases correspondingly. In presence of light paths unmodeled by the physical model, the distillation progress never finishes on affected pixels and the learned radiance field stays in the final rendering. With this designed tolerance for physical model limitations, we prevent unmodeled color components from leaking into light and material parameters, alleviating relighting artifacts. Meanwhile, the remaining radiance field compensates for the limitations of the physical model, guaranteeing high-quality novel views synthesis. Experimental results demonstrate that our method significantly outperforms state-of-the-art techniques quality-wise in both novel view synthesis and relighting. The idea of progressive radiance distillation is not limited to Gaussian splatting. We show that it also has positive effects for prominently specular scenes when adapted to a mesh-based inverse rendering method.

A Progressive Radiosity Algorithm Based on Piecewise Polynomial Intensity Distribution.

A Progressive Radiosity Algorithm for Scenes Containing Curved Surfaces.

A new progressive radiosity algorithm through the use of accurate form-factors

A New Radiosity Approach by Procedural Refinements for Realistic Image Sythesis

Efficient screen space approach for high complex dynamic scenes in real-time rendering

Accelerated Radiosity Method for Complex Environments

Multiresolution B-spline Radiosity

Conservative Piece-wise Parabolic Advective Remapping Method

An Illumination Distribution Preserved Colour Substitution Algorithm Based on Dichromatic Reflection Model

The Super-Plane Buffer: an Efficient Form-Factor Evaluation Algorithm for Progressive Radiosity.

Multirate Shading with Piecewise Interpolatory Approximation

An Efficient Form-Factor Evaluation Algorithm For Environments With Curved Surfaces

CPPM: chi-squared progressive photon mapping

Real-time Rendering Algorithm Based on a Hybrid Rendering Scheme

Rendering of Virtual Environments Based on Polygonal & Point-Based Models

Progressive Radiance Distillation for Inverse Rendering with Gaussian Splatting

Fast, Realistic Lighting and Material Design Using Nonlinear Cut Approximation

A Hybrid Model for Smoke Simulation

Real-Time Homogenous Translucent Material Editing

Polynomial for real-time rendering of neural radiance fields