Abstract:We present a versatile and robust framework to render a general class of implicit surfaces defined by black‐box functions, that is, our method is applicable to both discrete fields and procedurally defined input, including neural nets. Our technique is based on a pre‐processing step that generates an auxiliary data structure, the Lipschitz field, that is used during rendering to infer safe step sizes in computing ray‐surface intersections. We present a versatile and robust framework to render implicit surfaces defined by black‐box functions that only provide function value queries. We assume that the input function is locally Lipschitz continuous; however, we presume no prior knowledge of its Lipschitz constants. Our pre‐processing step generates a discrete acceleration structure, a Lipschitz field, that provides data to infer local and directional Lipschitz upper bounds. These bounds are used to compute safe step sizes along rays during rendering. The Lipschitz field is constructed by generating local polynomial approximations to the input function, then bounding the derivatives of the approximating polynomials. The accuracy of the approximation is controlled by the polynomial degree and the granularity of the spatial resolution used during fitting, which is independent from the resolution of the Lipschitz field. We demonstrate that our process can be implemented in a massively parallel way, enabling straightforward integration into interactive and real‐time modelling workflows. Since the construction only requires function value evaluations, the input surface may be represented either procedurally or as an arbitrarily filtered grid of function samples. We query the original implicit representation upon ray trace, as such, we preserve the geometric and topological details of the input as long as the Lipschitz field supplies conservative estimates. We demonstrate our method on both procedural and discrete implicit surfaces and compare its exact and approximate variants.

L-Tracing: Fast Light Visibility Estimation on Neural Surfaces by Sphere Tracing.

Joint Optimization of Triangle Mesh, Material, and Light from Neural Fields with Neural Radiance Cache

DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracing

NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracing

Factored-NeuS: Reconstructing Surfaces, Illumination, and Materials of Possibly Glossy Objects

Generalized Lipschitz Tracing of Implicit Surfaces

ProbeSDF: Light Field Probes for Neural Surface Reconstruction

I2-SDF: Intrinsic Indoor Scene Reconstruction and Editing Via Raytracing in Neural SDFs

Looking Through the Glass: Neural Surface Reconstruction Against High Specular Reflections

A Pre-convolved Representation for Plug-and-Play Neural Illumination Fields

Light Source Estimation with Analytical Path-tracing

Neural Reflectance Decomposition under Dynamic Point Light

TraM-NeRF: Tracing Mirror and Near-Perfect Specular Reflections through Neural Radiance Fields

Differentiable refraction-tracing for mesh reconstruction of transparent objects

Shape From Tracing: Towards Reconstructing 3D Object Geometry and SVBRDF Material from Images via Differentiable Path Tracing

Non-Line-of-Sight Reconstruction using Efficient Transient Rendering

NeuralTO: Neural Reconstruction and View Synthesis of Translucent Objects

Relit-NeuLF: Efficient Relighting and Novel View Synthesis Via Neural 4D Light Field

NeRFactor

LidaRF: Delving into Lidar for Neural Radiance Field on Street Scenes

Efficient ray-tracing for free-form reflectors