Abstract:Inverse rendering methods have achieved remarkable performance in reconstructing high-fidelity 3D objects with disentangled geometries, materials, and environmental light. However, they still face huge challenges in reflective surface reconstruction. Although recent methods model the light trace to learn specularity, the ignorance of indirect illumination makes it hard to handle inter-reflections among multiple smooth objects. In this work, we propose Ref-MC2 that introduces the multi-time Monte Carlo sampling which comprehensively computes the environmental illumination and meanwhile considers the reflective light from object surfaces. To address the computation challenge as the times of Monte Carlo sampling grow, we propose a specularity-adaptive sampling strategy, significantly reducing the computational complexity. Besides the computational resource, higher geometry accuracy is also required because geometric errors accumulate multiple times. Therefore, we further introduce a reflection-aware surface model to initialize the geometry and refine it during inverse rendering. We construct a challenging dataset containing scenes with multiple objects and inter-reflections. Experiments show that our method outperforms other inverse rendering methods on various object groups. We also show downstream applications, e.g., relighting and material editing, to illustrate the disentanglement ability of our method.

Real-Time Multi-scale Refraction under All-Frequency Environmental Lighting

Real-time Rendering of Refracting Transmissive Objects with Multi-Scale Rough Surfaces

Real-Time Rendering of Rough Refraction under Dynamically Varying Environmental Lighting

Real-time rendering of rough refraction

Realtime Rendering Glossy to Glossy Reflections in Screen Space

NeRRF: 3D Reconstruction and View Synthesis for Transparent and Specular Objects with Neural Refractive-Reflective Fields

Real-time Rendering of Transparency and Translucency with Rough Surfaces

Parallel and Adaptive Visibility Sampling for Rendering Dynamic Scenes with Spatially Varying Reflectance.

NEMTO: Neural Environment Matting for Novel View and Relighting Synthesis of Transparent Objects

Real-Time simulation of dynamic mirage scenes

A New Radiosity Approach by Procedural Refinements for Realistic Image Sythesis

Multi-interfaces Based Refractive Rendering.

Real-time rendering with complex natural illumination

An approximate image-space approach for real-time rendering of deformable translucent objects

Procedural Physically based BRDF for Real‐Time Rendering of Glints

Real-Time Rendering under Dynamic Environment Lighting

Multi-times Monte Carlo Rendering for Inter-reflection Reconstruction

All-Frequency Environment Light Rendering using Rotatable Square Light and Multiple Product Approximation

Real-Time Rendering of Layered Materials with Linearly Filterable Reflectance Model.

Real-Time Editing and Rendering of Translucent Materials with Homogeneous Diffuse BSSRDFs

Real-time Editing and Relighting of Homogeneous Translucent Materials.