Abstract:Light transport is a complex problem with many solutions. Practitioners are now faced with the difficult task of choosing which rendering algorithm to use for any given scene. Simple Monte Carlo methods, such as path tracing, work well for the majority of lighting scenarios, but introduce excessive variance when they encounter transport they cannot sample (such as caustics). More sophisticated rendering algorithms, such as bidirectional path tracing, handle a larger class of light transport robustly, but have a high computational overhead that makes them inefficient for scenes that are not dominated by difficult transport. The underlying problem is that rendering algorithms can only be executed indiscriminately on all transport, even though they may only offer improvement for a subset of paths. In this paper, we introduce a new scheme for selectively combining different Monte Carlo rendering algorithms. We use a simple transport method (e.g. path tracing) as the base, and treat high variance "fireflies" as seeds for a Markov chain that locally uses a Metropolised version of a more sophisticated transport method for exploration, removing the firefly in an unbiased manner. We use a weighting scheme inspired by multiple importance sampling to partition the integrand into regions the base method can sample well and those it cannot, and only use Metropolis for the latter. This constrains the Markov chain to paths where it offers improvement, and keeps it away from regions already handled well by the base estimator. Combined with stratified initialization, short chain lengths and careful allocation of samples, this vastly reduces non-uniform noise and temporal flickering artifacts normally encountered with a global application of Metropolis methods. Through careful design choices, we ensure our algorithm never performs much worse than the base estimator alone, and usually performs significantly better, thereby reducing the need to experiment with different algorithms for each scene.

Replica exchange light transport on relaxed distributions.

Retinex-Diffusion: On Controlling Illumination Conditions in Diffusion Models via Retinex Theory

Joint Optimization of Triangle Mesh, Material, and Light from Neural Fields with Neural Radiance Cache

Jump Restore Light Transport

Selectively metropolised Monte Carlo light transport simulation

Reversible Jump Metropolis Light Transport Using Inverse Mappings

A New Radiosity Approach by Procedural Refinements for Realistic Image Sythesis

A Matrix Sampling-And-Recovery Approach for Many-Lights Rendering

Spherical Gaussian-based Lightcuts for Glossy Interreflections.

Geometry-aware metropolis light transport

Markov Chain Mixture Models for Real‐Time Direct Illumination

Regional Adaptive Metropolis Light Transport

Diffusion Posterior Illumination for Ambiguity-aware Inverse Rendering

Point-based light transport for participating media with refractive boundaries

Antithetic sampling for Monte Carlo differentiable rendering

LightIt: Illumination Modeling and Control for Diffusion Models

Multi-times Monte Carlo Rendering for Inter-reflection Reconstruction

A Diffusion Approach to Radiance Field Relighting using Multi-Illumination Synthesis

Unbiased photon gathering for light transport simulation

A Diffusion Approach to Radiance Field Relighting using Multi‐Illumination Synthesis