Abstract:Inverse rendering methods have achieved remarkable performance in reconstructing high-fidelity 3D objects with disentangled geometries, materials, and environmental light. However, they still face huge challenges in reflective surface reconstruction. Although recent methods model the light trace to learn specularity, the ignorance of indirect illumination makes it hard to handle inter-reflections among multiple smooth objects. In this work, we propose Ref-MC2 that introduces the multi-time Monte Carlo sampling which comprehensively computes the environmental illumination and meanwhile considers the reflective light from object surfaces. To address the computation challenge as the times of Monte Carlo sampling grow, we propose a specularity-adaptive sampling strategy, significantly reducing the computational complexity. Besides the computational resource, higher geometry accuracy is also required because geometric errors accumulate multiple times. Therefore, we further introduce a reflection-aware surface model to initialize the geometry and refine it during inverse rendering. We construct a challenging dataset containing scenes with multiple objects and inter-reflections. Experiments show that our method outperforms other inverse rendering methods on various object groups. We also show downstream applications, e.g., relighting and material editing, to illustrate the disentanglement ability of our method.

Multi-interfaces Based Refractive Rendering.

Efficient screen space approach for high complex dynamic scenes in real-time rendering

Hardware-Accelerated Real-time Rendering of Water Surface

Real-time Rendering of Refracting Transmissive Objects with Multi-Scale Rough Surfaces

Interactive Relighting of Dynamic Refractive Objects

Reflection and Refraction on Implicit Surfaces

Real-Time Multi-scale Refraction under All-Frequency Environmental Lighting

Multi-times Monte Carlo Rendering for Inter-reflection Reconstruction

Real-Time simulation of dynamic mirage scenes

Real-time rendering of rough refraction

Real-Time Rendering of Rough Refraction under Dynamically Varying Environmental Lighting

Interactive Rendering of Non‐Constant, Refractive Media Using the Ray Equations of Gradient‐Index Optics

An approximate image-space approach for real-time rendering of deformable translucent objects

Realtime Rendering Glossy to Glossy Reflections in Screen Space

An interactive volume rendering algorithm for laser scanning confocal microscope data]

Interactive arbitrary-view rendering system using fast IBR and depth correction

Scalable Image-Based Indoor Scene Rendering with Reflections

Real-time Rendering of Transparency and Translucency with Rough Surfaces

Parallel Interactive Ray-Space Rendering Approach And Implementation

Interactive Approximate Rendering of Reflections, Refractions, and Caustics.

Foveated Light-Field Display and Real-Time Rendering for Virtual Reality