NeuFG: Neural Fuzzy Geometric Representation for 3D Reconstruction

Qingqi Hong,Chuanfeng Yang,Jiahui Chen,Zihan Li,Qingqiang Wu,Qingde Li,Jie Tian
DOI: https://doi.org/10.1109/tfuzz.2024.3447088
IF: 12.253
2024-01-01
IEEE Transactions on Fuzzy Systems
Abstract:3D reconstruction from multi-view images is considered as a longstanding problem in computer vision and graphics. In order to achieve high-fidelity geometry and appearance of 3D scenes, this paper proposes a novel geometric object learning method for multi-view reconstruction with fuzzy set theory . We establish a new neural 3D reconstruction theoretical frame called neural fuzzy geometric representation (NeuFG), which is a special type of implicit representation of geometric scene that only takes value in [0, 1]. NeuFG is essentially a volume image, and thus can be visualized directly with the conventional volume rendering technique. Extensive experiments on two public datasets, i.e., DTU and BlendedMVS, show that our method has the ability of accurately reconstructing complex shapes with vivid geometric details, without the requirement of mask supervision. Both qualitative and quantitative comparisons demonstrate that the proposed method has superior performance over the state-of-the-art neural scene representation methods. The code will be released on GitHub soon.
What problem does this paper attempt to address?