LiDeNeRF: Neural radiance field reconstruction with depth prior provided by LiDAR point cloud
Pengcheng Wei,Li Yan,Hong Xie,Dashi Qiu,Changcheng Qiu,Hao Wu,Yinghao Zhao,Xiao Hu,Ming Huang
DOI: https://doi.org/10.1016/j.isprsjprs.2024.01.017
IF: 12.7
2024-02-01
ISPRS Journal of Photogrammetry and Remote Sensing
Abstract:Neural Radiance Fields (NeRF) is a technique for reconstructing real-world scenes from multiple views. However, existing methods mostly focus on the visual effects of scene reconstruction while neglecting geometric accuracy, which is crucial in photogrammetry and remote sensing. In this paper, we propose a method called LiDeNeRF which uses LiDAR point cloud to provide depth priors for NeRF reconstruction. The goal of LiDeNeRF is to achieve real-time rendering of NeRF scenes and 3D reconstruction results with high geometric accuracy. In this method, first, the LiDAR point cloud is projected onto images to generate a sparse depth map. Then, by triangulating the sparse depth and using a multi-view image depth propagation method, a dense depth map with high accuracy is quickly generated as the depth prior for NeRF. Finally, a new depth correction module is designed and embedded into the NeRF rendering pipeline to improve the accuracy of scene depth estimation. The experimental results evince that our methodology has attained paramount performance in both novel view synthesis and 3D reconstruction tasks. Our source code is made available at https://github.com/WPC-WHU/LiDeNeRF .
imaging science & photographic technology,remote sensing,geography, physical,geosciences, multidisciplinary