Abstract:Neural Radiance Fields (NeRF) are an advanced technology that creates highly realistic images by learning about scenes through a neural network model. However, NeRF often encounters issues when there are not enough images to work with, leading to problems in accurately rendering views. The main issue is that NeRF lacks sufficient structural details to guide the rendering process accurately. To address this, we proposed a Depth and Normal Dense Completion Priors for NeRF (CP\_NeRF) framework. This framework enhances view rendering by adding depth and normal dense completion priors to the NeRF optimization process. Before optimizing NeRF, we obtain sparse depth maps using the Structure from Motion (SfM) technique used to get camera poses. Based on the sparse depth maps and a normal estimator, we generate sparse normal maps for training a normal completion prior with precise standard deviations. During optimization, we apply depth and normal completion priors to transform sparse data into dense depth and normal maps with their standard deviations. We use these dense maps to guide ray sampling, assist distance sampling and construct a normal loss function for better training accuracy. To improve the rendering of NeRF's normal outputs, we incorporate an optical centre position embedder that helps synthesize more accurate normals through volume rendering. Additionally, we employ a normal patch matching technique to choose accurate rendered normal maps, ensuring more precise supervision for the model. Our method is superior to leading techniques in rendering detailed indoor scenes, even with limited input views.

Neural Parametric Mixtures for Path Guiding

Efficient Neural Path Guiding with 4D Modeling

Photon-Driven Neural Path Guiding

Online Neural Path Guiding with Normalized Anisotropic Spherical Gaussians

Gain-Varying Guidance Algorithm using Differential Geometric Guidance Command

Neural Global Illumination Via Superposed Deformable Feature Fields

A Practical Path Guiding Method for Participating Media

Rethinking Directional Parameterization in Neural Implicit Surface Reconstruction

Characteristic Guidance: Non-linear Correction for Diffusion Model at Large Guidance Scale

Parameterization-driven Neural Surface Reconstruction for Object-oriented Editing in Neural Rendering

BAA-NGP: Bundle-Adjusting Accelerated Neural Graphics Primitives

CATNIPS: Collision Avoidance Through Neural Implicit Probabilistic Scenes

Nonlinear Augmented Proportional Navigation for Midrange Rendezvous Guidance and Performance Assessment

Parametric Modeling and Estimation of Photon Registrations for 3D Imaging

NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance

Nonlinear Optimal Guidance for Cooperatively Imposing Relative Intercept Angles

Neural Elevation Models for Terrain Mapping and Path Planning

Enhancing Neural Radiance Fields with Depth and Normal Completion Priors from Sparse Views

Dynamic Neural Radiosity with Multi-grid Decomposition

HG3-NeRF: Hierarchical Geometric, Semantic, and Photometric Guided Neural Radiance Fields for Sparse View Inputs

Neural-g: A Deep Learning Framework for Mixing Density Estimation