Abstract:AbstractWe present a novel neural surface reconstruction method called NeuralRoom for reconstructing room-sized indoor scenes directly from a set of 2D images. Recently, implicit neural representations have become a promising way to reconstruct surfaces from multiview images due to their high-quality results and simplicity. However, implicit neural representations usually cannot reconstruct indoor scenes well because they suffer severe shape-radiance ambiguity. We assume that the indoor scene consists of texture-rich and flat texture-less regions. In texture-rich regions, the multiview stereo can obtain accurate results. In the flat area, normal estimation networks usually obtain a good normal estimation. Based on the above observations, we reduce the possible spatial variation range of implicit neural surfaces by reliable geometric priors to alleviate shape-radiance ambiguity. Specifically, we use multiview stereo results to limit the NeuralRoom optimization space and then use reliable geometric priors to guide NeuralRoom training. Then the NeuralRoom would produce a neural scene representation that can render an image consistent with the input training images. In addition, we propose a smoothing method called perturbation-residual restrictions to improve the accuracy and completeness of the flat region, which assumes that the sampling points in a local surface should have the same normal and similar distance to the observation center. Experiments on the ScanNet dataset show that our method can reconstruct the texture-less area of indoor scenes while maintaining the accuracy of detail. We also apply NeuralRoom to more advanced multiview reconstruction algorithms and significantly improve their reconstruction quality.

Self-Supervised Implicit 3D Reconstruction via RGB-D Scans.

Three-Dimensional Reconstruction of Indoor Scenes Based on Implicit Neural Representation

MonoSelfRecon: Purely Self-Supervised Explicit Generalizable 3D Reconstruction of Indoor Scenes from Monocular RGB Views

Neural Implicit 3D Reconstruction with Double Supervision

Self-Calibrated Neural Implicit 3D Reconstruction

Neural 3D Scene Reconstruction from Multiple 2D Images without 3D Supervision

Efficient Implicit Neural Reconstruction Using LiDAR

Robust 3D Reconstruction with an RGB-D Camera

Neural 3D Reconstruction in the Wild

SSR-2D: Semantic 3D Scene Reconstruction from 2D Images

Neural 3D Scene Reconstruction from Multi-view Images without 3D Supervision

Visual Odometry Based 3D-Reconstruction

Semantic Reconstruction based on RGB Image and Sparse Depth

Neural 3D Scene Reconstruction with Indoor Planar Priors

SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scans

Neural 3D Scene Reconstruction with the Manhattan-world Assumption

Edge-aware Neural Implicit Surface Reconstruction

Fine-detailed Neural Indoor Scene Reconstruction using multi-level importance sampling and multi-view consistency

NeuralRoom: Geometry-Constrained Neural Implicit Surfaces for Indoor Scene Reconstruction.

SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fields

Learning to Reconstruct and Understand Indoor Scenes from Sparse Views