Abstract:Recent work on Neural Radiance Fields (NeRF) has demonstrated significant advances in high-quality view synthesis. A major limitation of NeRF is its low rendering efficiency due to the need for multiple network forwardings to render a single pixel. Existing methods to improve NeRF either reduce the number of required samples or optimize the implementation to accelerate the network forwarding. Despite these efforts, the problem of multiple sampling persists due to the intrinsic representation of radiance fields. In contrast, Neural Light Fields (NeLF) reduce the computation cost of NeRF by querying only one single network forwarding per pixel. To achieve a close visual quality to NeRF, existing NeLF methods require significantly larger network capacities which limits their rendering efficiency in practice. In this work, we propose a new representation called Neural Radiance Distribution Field (NeRDF) that targets efficient view synthesis in real-time. Specifically, we use a small network similar to NeRF while preserving the rendering speed with a single network forwarding per pixel as in NeLF. The key is to model the radiance distribution along each ray with frequency basis and predict frequency weights using the network. Pixel values are then computed via volume rendering on radiance distributions. Experiments show that our proposed method offers a better trade-off among speed, quality, and network size than existing methods: we achieve a ~254x speed-up over NeRF with similar network size, with only a marginal performance decline. Our project page is at <a class="link-external link-http" href="http://yushuang-wu.github.io/NeRDF" rel="external noopener nofollow">this http URL</a>.

Digging into radiance grid for real-time view synthesis with detail preservation

Baking Neural Radiance Fields for Real-Time View Synthesis

Grid-guided Neural Radiance Fields for Large Urban Scenes

Neural Deformable Voxel Grid for Fast Optimization of Dynamic View Synthesis

Hyb-NeRF: A Multiresolution Hybrid Encoding for Neural Radiance Fields

Efficient View Synthesis with Neural Radiance Distribution Field

PyNeRF: Pyramidal Neural Radiance Fields

Ced-NeRF: A Compact and Efficient Method for Dynamic Neural Radiance Fields

NeRF-SDP: Efficient Generalizable Neural Radiance Field with Scene Depth Perception.

Neural Radiance Fields with Hash-Low-Rank Decomposition

Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields

Capturing Detail Variations for Lightweight Neural Radiance Fields.

Efficient large-scale scene representation with a hybrid of high-resolution grid and plane features

VGOS: Voxel Grid Optimization for View Synthesis from Sparse Inputs

Learning Neural Duplex Radiance Fields for Real-Time View Synthesis

Dip-NeRF: Depth-Based Anti-Aliased Neural Radiance Fields

NeRF-SR: High Quality Neural Radiance Fields Using Supersampling

ASSR-NeRF: Arbitrary-Scale Super-Resolution on Voxel Grid for High-Quality Radiance Fields Reconstruction

HeRF: A Hierarchical Framework for Efficient and Extendable New View Synthesis

Improving Neural Radiance Field using Near-Surface Sampling with Point Cloud Generation