Abstract:Neural Radiance Fields (NeRF) are an advanced technology that creates highly realistic images by learning about scenes through a neural network model. However, NeRF often encounters issues when there are not enough images to work with, leading to problems in accurately rendering views. The main issue is that NeRF lacks sufficient structural details to guide the rendering process accurately. To address this, we proposed a Depth and Normal Dense Completion Priors for NeRF (CP\_NeRF) framework. This framework enhances view rendering by adding depth and normal dense completion priors to the NeRF optimization process. Before optimizing NeRF, we obtain sparse depth maps using the Structure from Motion (SfM) technique used to get camera poses. Based on the sparse depth maps and a normal estimator, we generate sparse normal maps for training a normal completion prior with precise standard deviations. During optimization, we apply depth and normal completion priors to transform sparse data into dense depth and normal maps with their standard deviations. We use these dense maps to guide ray sampling, assist distance sampling and construct a normal loss function for better training accuracy. To improve the rendering of NeRF's normal outputs, we incorporate an optical centre position embedder that helps synthesize more accurate normals through volume rendering. Additionally, we employ a normal patch matching technique to choose accurate rendered normal maps, ensuring more precise supervision for the model. Our method is superior to leading techniques in rendering detailed indoor scenes, even with limited input views.

RDNeRF: Relative Depth Guided NeRF for Dense Free View Synthesis

StructNeRF: Neural Radiance Fields for Indoor Scenes With Structural Hints

NeRFVS: Neural Radiance Fields for Free View Synthesis Via Geometry Scaffolds

Enhancing View Synthesis with Depth-Guided Neural Radiance Fields and Improved Depth Completion

Neural Radiance Fields From Sparse RGB-D Images for High-Quality View Synthesis

3D Reconstruction and New View Synthesis of Indoor Environments based on a Dual Neural Radiance Field

Depth-supervised NeRF: Fewer Views and Faster Training for Free

HG3-NeRF: Hierarchical Geometric, Semantic, and Photometric Guided Neural Radiance Fields for Sparse View Inputs

Single-view Neural Radiance Fields with Depth Teacher

Prior-Driven NeRF: Prior Guided Rendering

SN 2 eRF: A Framework for Neural Radiance Fields given Sparse and Noisy Poses

Dense Depth Priors for Neural Radiance Fields from Sparse Input Views

NeRF-SDP: Efficient Generalizable Neural Radiance Field with Scene Depth Perception.

Depth assisted novel view synthesis using few images

NeRF synthesis with shading guidance

Enhancing Neural Radiance Fields with Depth and Normal Completion Priors from Sparse Views

Multi-View Stereo and Depth Priors Guided NeRF for View Synthesis.

SGCNeRF: Few-Shot Neural Rendering via Sparse Geometric Consistency Guidance

S-NeRF: Neural Radiance Fields for Street Views

NeRFReN: Neural Radiance Fields with Reflections

Clean-NeRF: Reformulating NeRF to account for View-Dependent Observations