Abstract:The emergence of the generalized neural radiance field models has greatly expanded the applicability of novel view synthesis task. However, existing methods primarily rely on 2D features obtained from neighboring views to assist the rendering, which often leads to degradation in unseen viewpoints. Some approaches introduce cost volumes in the model to provide geometric priors, but such coarse geometric information fails to constrain the model effectively, resulting in rendered images with abundant artifacts. In this work, we propose to provide the model with hierarchical geometry constraints to achieve better rendering results. We introduce cascaded MVSNet to provide hierarchical scene structural features for inferring the underlying scene geometry. It constrains the model’s rendering under unseen viewpoints. Also, the hierarchical features provide fine representations that helps the reconstruction of details. Additionally, we utilize the hierarchical depth maps generated by cascade MVSNet to constrain the sampling process, ensuring that the sampled points are concentrated near the scene surface. Such sampling strategy filtering out numerous useless sampling points and improving both the sampling efficiency and rendering quality. Unlike previous generalized methods, we employ a new weight function proposed by Neus to eliminate inherent biases in the density field, disentangling the prediction of color and density with a signed distance field. Extensive experiments have demonstrated that our proposed method significantly improves the rendering quality and outperforms previous methods.

A Hierarchical Architecture for Neural Materials

A Hierarchical Architecture for Neural Materials

Joint Optimization of Triangle Mesh, Material, and Light from Neural Fields with Neural Radiance Cache

Neural Appearance Modeling From Single Images

Ultra-High Resolution SVBRDF Recovery from a Single Image

NeuMIP: Multi-Resolution Neural Materials

Real-Time Neural Appearance Models

A Multiresolution Network Architecture for Deferred Neural Lighting

ReN Human: Learning Relightable Neural Implicit Surfaces for Animatable Human Rendering

Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance Modeling

Neural Global Illumination Via Superposed Deformable Feature Fields

Neural BRDF Representation and Importance Sampling

A Flexible Neural Renderer for Material Visualization

RNA: Relightable Neural Assets

Generalizable Neural Radiance Field with Hierarchical Geometry Constraint.

NeuMaDiff: Neural Material Synthesis via Hyperdiffusion

Neural Reflectance for Shape Recovery with Shadow Handling

IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesis

Reflectance Edge Guided Networks for Detail-Preserving Intrinsic Image Decomposition.