Booth-NeRF: an FPGA Accelerator for Instant-NGP Inference with Novel Booth-Multiplier

Zihang Ma,Zeyu Li,Yuanfang Wang,Yu Li,Jun Yu,Kun Wang
DOI: https://doi.org/10.1109/asp-dac58780.2024.10473990
2024-01-01
Abstract:Instant-NGP is the state-of-the-art (SOTA) algorithm of Neural Radiance Field (NeRF) and shows great potential to be adopted in AR/VR. However, the high cost of memory and computation limits Instant-NGP's implementation on edge devices. In light of this, we propose a novel FPGA-based accelerator to reduce power consumption, called Booth-NeRF. Booth-NeRF adopts a fully-pipelined technique and is built upon the Booth algorithm. In addition, it introduces a new instruction set to accommodate Multi-Layer Perceptrons (MLPs) of different sizes, ensuring flexibility and efficiency. Moreover, we propose an FPGA-friendly multiplier architecture for matrix multiplication which is capable of performing exact or approximate multiplication using the Booth algorithm and the select-shift-add technique. Evaluations with a Xilinx Kintex XC7K325T board show that Booth-NeRF achieves 2.20x speedup and 1.31x energy efficiency compared with NVIDIA Jetson Xavier NX-16G GPU.
What problem does this paper attempt to address?