Abstract:Given only a set of images, neural implicit surface representation has shown its capability in 3D surface reconstruction. However, as the nature of per-scene optimization is based on the volumetric rendering of color, previous neural implicit surface reconstruction methods usually fail in low-textured regions, including the floors, walls, etc., which commonly exist for indoor scenes. Being aware of the fact that these low-textured regions usually correspond to planes, without introducing additional ground-truth supervisory signals or making additional assumptions about the room layout, we propose to leverage a novel Pseudo Plane-regularized Signed Distance Field (P$^2$SDF) for indoor scene reconstruction. Specifically, we consider adjacent pixels with similar colors to be on the same pseudo planes. The plane parameters are then estimated on the fly during training by an efficient and effective two-step scheme. Then the signed distances of the points on the planes are regularized by the estimated plane parameters in the training phase. As the unsupervised plane segments are usually noisy and inaccurate, we propose to assign different weights to the sampled points on the plane in plane estimation as well as the regularization loss. The weights come by fusing the plane segments from different views. As the sampled rays in the planar regions are redundant, leading to inefficient training, we further propose a keypoint-guided rays sampling strategy that attends to the informative textured regions with large color variations, and the implicit network gets a better reconstruction, compared with the original uniform ray sampling strategy. Experiments show that our P$^2$SDF achieves competitive reconstruction performance in Manhattan scenes. Further, as we do not introduce any additional room layout assumption, our P$^2$SDF generalizes well to the reconstruction of non-Manhattan scenes.

Learning a Room with the Occ-SDF Hybrid: Signed Distance Function Mingled with Occupancy Aids Scene Representation

I2-SDF: Intrinsic Indoor Scene Reconstruction and Editing Via Raytracing in Neural SDFs

Neural Rendering in a Room: Amodal 3D Understanding and Free-Viewpoint Rendering for the Closed Scene Composed of Pre-Captured Objects

DebSDF: Delving into the Details and Bias of Neural Indoor Scene Reconstruction

SDFMAP: Neural Signed Distance Fields for Mapping and Positioning in Real-Time

GaussianRoom: Improving 3D Gaussian Splatting with SDF Guidance and Monocular Cues for Indoor Scene Reconstruction

NC-SDF: Enhancing Indoor Scene Reconstruction Using Neural SDFs with View-Dependent Normal Compensation

P$^2$SDF for Neural Indoor Scene Reconstruction

Ray-Distance Volume Rendering for Neural Scene Reconstruction

GSDF: 3DGS Meets SDF for Improved Rendering and Reconstruction

Object-Compositional Neural Implicit Surfaces

I$^2$-SDF: Intrinsic Indoor Scene Reconstruction and Editing via Raytracing in Neural SDFs

ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstruction

Learning Occupancy Function from Point Clouds for Surface Reconstruction

Three-Dimensional Reconstruction of Indoor Scenes Based on Implicit Neural Representation

Unsupervised Occupancy Learning from Sparse Point Cloud

Fine-detailed Neural Indoor Scene Reconstruction using multi-level importance sampling and multi-view consistency

SDF-SRN: Learning Signed Distance 3D Object Reconstruction from Static Images

Depth Reconstruction with Neural Signed Distance Fields in Structured Light Systems

Indoor Scene Reconstruction with Fine-Grained Details Using Hybrid Representation and Normal Prior Enhancement

H2O-SDF: Two-phase Learning for 3D Indoor Reconstruction using Object Surface Fields