Abstract:Neural radiance fields have revolutionized the field of novel view synthesis, achieving remarkable results. However, traditional approaches based on implicit representations, particularly those built upon NeRF, suffer from slow rendering speeds due to the need for numerous MLP evaluations. Recently, there has been a promising shift towards explicit representations using voxel grids, which has significantly improved reconstruction times for static scenes. Nonetheless, extending these methods from static scenes to dynamic scenes is a non-trivial task as it requires accounting for the changing geometry and appearance of the scene over time. In this paper, we propose an efficient dynamic neural radiance field with multi-scale explicit voxel interpolation and temporal encoding. We leverage an explicit voxel structure to store the 3D dynamic features, while employing a lightweight MLP to estimate the displacement, thereby significantly enhancing the reconstruction speed. In our canonical module, we incorporated temporal information encoding in density estimation and color estimation to rectify the error estimation of the displacement in deformation module. In addition, a multi-scale voxel interpolation is designed to accommodate large-scale motions while meticulously capturing intricate details in small-scale motions in the density estimation module. In experiment, we evaluate our MVoxTi-DNeRF method on both synthetic and real scenes, where it achieves superior or comparable rendering quality compared to state of the art methods, while remaining computationally efficient (more than 60 x faster than the original DNeRF). More experiment results and test code are available at https://github.com/CHenYYff/MVoxTi-DNeRF

Fast Dynamic Radiance Fields with Time-Aware Neural Voxels

MVoxTi-DNeRF: Explicit Multi-Scale Voxel Interpolation and Temporal Encoding Network for Efficient Dynamic Neural Radiance Field

Neural Deformable Voxel Grid for Fast Optimization of Dynamic View Synthesis

Ced-NeRF: A Compact and Efficient Method for Dynamic Neural Radiance Fields

ACFNeRF: Accelerating and Cache-Free Neural Rendering Via Point Cloud-Based Distance Fields.

DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes

Depth Guided Fast Rendering Neural Radiance Fields

RT-Octree: Accelerate PlenOctree Rendering with Batched Regular Tracking and Neural Denoising for Real-time Neural Radiance Fields.

TinyNeRF: Towards 100 x Compression of Voxel Radiance Fields

Efficient Neural Radiance Fields with Learned Depth-Guided Sampling

VoxNeRF: Bridging Voxel Representation and Neural Radiance Fields for Enhanced Indoor View Synthesis

NeVRF: Neural Video-based Radiance Fields for Long-duration Sequences

Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-time

Volume Feature Rendering for Fast Neural Radiance Field Reconstruction

Baking Neural Radiance Fields for Real-Time View Synthesis

DOUBLE NERF: REPRESENTING DYNAMIC SCENES AS NEURAL RADIANCE FIELDS

Generalizable Neural Voxels for Fast Human Radiance Fields

NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction

TensoRF: Tensorial Radiance Fields

Adaptive Multi-NeRF: Exploit Efficient Parallelism in Adaptive Multiple Scale Neural Radiance Field Rendering

Fast Radiance Field Reconstruction from Sparse Inputs