Abstract:Neural radiance fields (NeRF) synthesize realistic novel views by estimating point attributes (density and color), followed by the volume rendering method. However, accurately predicting the arbitrary point attributes poses a challenge for the single NeRF-based model. Such limitation directly impacts the quality of novel view synthesis. To address this problem, a collaborative strategy with multiple NeRF-based models is proposed. This strategy is the first to introduce a multi-model cascaded architecture into NeRF for achieving high-quality novel view synthesis. Its purpose is to utilize a cascading architecture in space for the progressive enhancement of point attribute accuracy. The cascading architecture includes point adjustment and snapshots fusion. Specifically, point adjustment leverages a pretrained NeRF-based model to predict the initial density and color of each point in space. This step affords an initial rendering of target scene. Then, these initial density and color of points are directly transferred to the subsequent NeRF-based model. This process guides the subsequent NeRF-based model to focus on the refinement of initial point attributes and synthesize more realistic novel views. Finally, snapshots fusion fuses outputs (referred as snapshots) from multiple parallel subsequent NeRF-based models to synthesize the ultimate high-quality novel views. The proposed strategy is tested with a range of established NeRF-based methods, such as NeRF, Instant-NGP, and TensoRF. Experimental data for this research are sourced from the realistic 360 synthetic dataset and the LLFF dataset. Results indicate that the proposed collaborative strategy with established NeRF-based methods can improve the quality of novel view synthesis, surpassing the corresponding single model. Our project page is available at https://github.com/ZhenyangLiu/Collaborative-Neural-Radiance-Fields-for-Novel-View-Synthesis.

NeRF-Con : Neural Radiance Fields for Automated Construction Progress Monitoring

Enhance-NeRF: Multiple Performance Evaluation for Neural Radiance Fields

Crowd-Sourced NeRF: Collecting Data from Production Vehicles for 3D Street View Reconstruction

3D Reconstruction of Building Structures Incorporating Neural Radiation Fields and Geometric Constraints

NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review

NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections

Leveraging Neural Radiance Fields for Large-Scale 3D Reconstruction from Aerial Imagery

Evaluating Neural Radiance Fields (NeRFs) for 3D Plant Geometry Reconstruction in Field Conditions

Evaluating Neural Radiance Fields for 3D Plant Geometry Reconstruction in Field Conditions

AgriNeRF: Neural Radiance Fields for Agriculture in Challenging Lighting Conditions

Improving Neural Radiance Field using Near-Surface Sampling with Point Cloud Generation

NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild

DaRF: Boosting Radiance Fields from Sparse Inputs with Monocular Depth Adaptation

Towards a Robust Framework for NeRF Evaluation

Drone-NeRF: Efficient NeRF based 3D scene reconstruction for large-scale drone survey

Neural Rendering-Based Semantic Point Cloud Retrieval for Indoor Construction Progress Monitoring

FlyNeRF: NeRF-Based Aerial Mapping for High-Quality 3D Scene Reconstruction

Collaborative neural radiance fields for novel view synthesis

Transient Neural Radiance Fields for Lidar View Synthesis and 3D Reconstruction

DecentNeRFs: Decentralized Neural Radiance Fields from Crowdsourced Images