Abstract:Deep neural networks (DNNs) are widely applied for nowadays 3D surface reconstruction tasks and such methods can be further divided into two categories, which respectively warp templates explicitly by moving vertices or represent 3D surfaces implicitly as signed or unsigned distance functions. Taking advantage of both advanced explicit learning process and powerful representation ability of implicit functions, we propose a novel 3D representation method, Neural Vector Fields (NVF). It not only adopts the explicit learning process to manipulate meshes directly, but also leverages the implicit representation of unsigned distance functions (UDFs) to break the barriers in resolution and topology. Specifically, our method first predicts the displacements from queries towards the surface and models the shapes as \textit{Vector Fields}. Rather than relying on network differentiation to obtain direction fields as most existing UDF-based methods, the produced vector fields encode the distance and direction fields both and mitigate the ambiguity at "ridge" points, such that the calculation of direction fields is straightforward and differentiation-free. The differentiation-free characteristic enables us to further learn a shape codebook via Vector Quantization, which encodes the cross-object priors, accelerates the training procedure, and boosts model generalization on cross-category reconstruction. The extensive experiments on surface reconstruction benchmarks indicate that our method outperforms those state-of-the-art methods in different evaluation scenarios including watertight vs non-watertight shapes, category-specific vs category-agnostic reconstruction, category-unseen reconstruction, and cross-domain reconstruction. Our code is released at <a class="link-external link-https" href="https://github.com/Wi-sc/NVF" rel="external noopener nofollow">this https URL</a>.

Implicit Neural Distance Optimization for Mesh Neural Subdivision

Neural subdivision

NeuMesh: Learning Disentangled Neural Mesh-Based Implicit Field for Geometry and Texture Editing.

NeuralIndicator: Implicit Surface Reconstruction from Neural Indicator Priors

High-Resolution and Efficient Neural Dual Contouring for Surface Reconstruction from Point Clouds

Neural-IMLS: Self-supervised Implicit Moving Least-Squares Network for Surface Reconstruction

OctField: Hierarchical Implicit Functions for 3D Modeling

Deep Implicit Moving Least-Squares Functions for 3D Reconstruction

Edge-aware Neural Implicit Surface Reconstruction

Optimizing 3D Geometry Reconstruction from Implicit Neural Representations

Recovering Fine Details for Neural Implicit Surface Reconstruction

Anti-Aliased Neural Implicit Surfaces with Encoding Level of Detail

NeuDA: Neural Deformable Anchor for High-Fidelity Implicit Surface Reconstruction

Neural Unsigned Distance Fields for Implicit Function Learning

NeuralMeshing: Differentiable Meshing of Implicit Neural Representations

Object-Compositional Neural Implicit Surfaces

DiGS : Divergence guided shape implicit neural representation for unoriented point clouds

Efficient Implicit Neural Reconstruction Using LiDAR

Fine-detailed Neural Indoor Scene Reconstruction using multi-level importance sampling and multi-view consistency

Implicit Filtering for Learning Neural Signed Distance Functions from 3D Point Clouds

Neural Vector Fields: Implicit Representation by Explicit Learning