Abstract:In this work we target a learnable output representation that allows continuous, high resolution outputs of arbitrary shape. Recent works represent 3D surfaces implicitly with a Neural Network, thereby breaking previous barriers in resolution, and ability to represent diverse topologies. However, neural implicit representations are limited to closed surfaces, which divide the space into inside and outside. Many real world objects such as walls of a scene scanned by a sensor, clothing, or a car with inner structures are not closed. This constitutes a significant barrier, in terms of data pre-processing (objects need to be artificially closed creating artifacts), and the ability to output open surfaces. In this work, we propose Neural Distance Fields (NDF), a neural network based model which predicts the unsigned distance field for arbitrary 3D shapes given sparse point clouds. NDF represent surfaces at high resolutions as prior implicit models, but do not require closed surface data, and significantly broaden the class of representable shapes in the output. NDF allow to extract the surface as very dense point clouds and as meshes. We also show that NDF allow for surface normal calculation and can be rendered using a slight modification of sphere tracing. We find NDF can be used for multi-target regression (multiple outputs for one input) with techniques that have been exclusively used for rendering in graphics. Experiments on ShapeNet show that NDF, while simple, is the state-of-the art, and allows to reconstruct shapes with inner structures, such as the chairs inside a bus. Notably, we show that NDF are not restricted to 3D shapes, and can approximate more general open surfaces such as curves, manifolds, and functions. Code is available for research at https://virtualhumans.mpi-inf.mpg.de/ndf/.

Learning Density Regulated and Multi-View Consistent Unsigned Distance Fields.

NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies

CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimization

Learning Unsigned Distance Fields from Local Shape Functions for 3D Surface Reconstruction

NeUDF: Leaning Neural Unsigned Distance Fields with Volume Rendering

Learnable Chamfer Distance for Point Cloud Reconstruction

Details Enhancement in Unsigned Distance Field Learning for High-fidelity 3D Surface Reconstruction

DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scaling

MD-Surf: Multimodal Neural Surface Reconstruction from Driving Views

Unsigned Orthogonal Distance Fields: An Accurate Neural Implicit Representation for Diverse 3D Shapes

Monge-Ampere Regularization for Learning Arbitrary Shapes from Point Clouds

HSDF: Hybrid Sign and Distance Field for Neural Representation of Surfaces with Arbitrary Topologies

SDFMAP: Neural Signed Distance Fields for Mapping and Positioning in Real-Time

Learning Unsigned Distance Functions from Multi-view Images with Volume Rendering Priors

Neural Density-Distance Fields

Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping

Neural Surface Detection for Unsigned Distance Fields

Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projection

Neural Unsigned Distance Fields for Implicit Function Learning

Learning Signed Distance Functions from Noisy 3D Point Clouds via Noise to Noise Mapping