NeRF As a Non-Distant Environment Emitter in Physics-based Inverse Rendering

Jingwang Ling,Ruihan Yu,Feng Xu,Chun Du,Shuang Zhao
DOI: https://doi.org/10.1145/3641519.3657404
2024-01-01
Abstract:Physics-based inverse rendering enables joint optimization of shape,material, and lighting based on captured 2D images. To ensure accuratereconstruction, using a light model that closely resembles the capturedenvironment is essential. Although the widely adopted distant environmentallighting model is adequate in many cases, we demonstrate that its inability tocapture spatially varying illumination can lead to inaccurate reconstructionsin many real-world inverse rendering scenarios. To address this limitation, weincorporate NeRF as a non-distant environment emitter into the inverserendering pipeline. Additionally, we introduce an emitter importance samplingtechnique for NeRF to reduce the rendering variance. Through comparisons onboth real and synthetic datasets, our results demonstrate that our NeRF-basedemitter offers a more precise representation of scene lighting, therebyimproving the accuracy of inverse rendering.
What problem does this paper attempt to address?