Abstract:Implicit neural rendering, using signed distance function (SDF) representation with geometric priors like depth or surface normal, has made impressive strides in the surface reconstruction of large-scale scenes. However, applying this method to reconstruct a room-level scene from images may miss structures in low-intensity areas and/or small, thin objects. We have conducted experiments on three datasets to identify limitations of the original color rendering loss and priors-embedded SDF scene representation.Our findings show that the color rendering loss creates an optimization bias against low-intensity areas, resulting in gradient vanishing and leaving these areas unoptimized. To address this issue, we propose a feature-based color rendering loss that utilizes non-zero feature values to bring back optimization signals. Additionally, the SDF representation can be influenced by objects along a ray path, disrupting the monotonic change of SDF values when a single object is present. Accordingly, we explore using the occupancy representation, which encodes each point separately and is unaffected by objects along a querying ray. Our experimental results demonstrate that the joint forces of the feature-based rendering loss and Occ-SDF hybrid representation scheme can provide high-quality reconstruction results, especially in challenging room-level scenarios. The code is available at https://github.com/shawLyu/Occ-SDF_Hybrid.

A Deep Learning based Fast Signed Distance Map Generation

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

SDFMAP: Neural Signed Distance Fields for Mapping and Positioning in Real-Time

A Deep Signed Directional Distance Function for Object Shape Representation

Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping

DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation

Brain Surface Reconstruction from MRI Images Based on Segmentation Networks Applying Signed Distance Maps

Shape-Aware Organ Segmentation by Predicting Signed Distance Maps

SDF-SRN: Learning Signed Distance 3D Object Reconstruction from Static Images

Guiding 3D U-nets with signed distance fields for creating 3D models from images

Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Set

Learning Signed Distance Functions from Noisy 3D Point Clouds via Noise to Noise Mapping

Neural Implicit Mapping via Nested Neighborhoods

Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstruction

Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space Onto Surfaces

DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstruction

Unsigned Orthogonal Distance Fields: An Accurate Neural Implicit Representation for Diverse 3D Shapes

Depth Reconstruction with Neural Signed Distance Fields in Structured Light Systems

Learning a Room with the Occ-SDF Hybrid: Signed Distance Function Mingled with Occupancy Aids Scene Representation

Learning Deep SDF Maps Online for Robot Navigation and Exploration

Deep Spatiality: Unsupervised Learning of Spatially-Enhanced Global and Local 3D Features by Deep Neural Network With Coupled Softmax.