Abstract:The reconstruction of indoor scenes from multi-view RGB images is challenging due to the coexistence of flat and texture-less regions alongside delicate and fine-grained regions. Recent methods leverage neural radiance fields aided by predicted surface normal priors to recover the scene geometry. These methods excel in producing complete and smooth results for floor and wall areas. However, they struggle to capture complex surfaces with high-frequency structures due to the inadequate neural representation and the inaccurately predicted normal priors. This work aims to reconstruct high-fidelity surfaces with fine-grained details by addressing the above limitations. To improve the capacity of the implicit representation, we propose a hybrid architecture to represent low-frequency and high-frequency regions separately. To enhance the normal priors, we introduce a simple yet effective image sharpening and denoising technique, coupled with a network that estimates the pixel-wise uncertainty of the predicted surface normal vectors. Identifying such uncertainty can prevent our model from being misled by unreliable surface normal supervisions that hinder the accurate reconstruction of intricate geometries. Experiments on the benchmark datasets show that our method outperforms existing methods in terms of reconstruction quality. Furthermore, the proposed method also generalizes well to real-world indoor scenarios captured by our hand-held mobile phones. Our code is publicly available at: <a class="link-external link-https" href="https://github.com/yec22/Fine-Grained-Indoor-Recon" rel="external noopener nofollow">this https URL</a>.

Scalable Neural Indoor Scene Rendering.

ScaNeRF: Scalable Bundle-Adjusting Neural Radiance Fields for Large-Scale Scene Rendering

Scalable Image-Based Indoor Scene Rendering with Reflections

Neural Rendering in a Room: Amodal 3D Understanding and Free-Viewpoint Rendering for the Closed Scene Composed of Pre-Captured Objects

I2-SDF: Intrinsic Indoor Scene Reconstruction and Editing Via Raytracing in Neural SDFs

Point-Based Neural Scene Rendering for Street Views

Real-Time Neural Rasterization for Large Scenes

DistGrid: Scalable Scene Reconstruction with Distributed Multi-resolution Hash Grid

Neural Global Illumination Via Superposed Deformable Feature Fields

Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networks

MM-NeRF: Large-Scale Scene Representation with Multi-Resolution Hash Grid and Multi-View Priors Features

Scalable Indoor Novel-View Synthesis using Drone-Captured 360 Imagery with 3D Gaussian Splatting

Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenes

SCALAR-NeRF: SCAlable LARge-scale Neural Radiance Fields for Scene Reconstruction

Neural Fields Meet Explicit Geometric Representations for Inverse Rendering of Urban Scenes

Multiscale Representation for Real-Time Anti-Aliasing Neural Rendering

Ray-Distance Volume Rendering for Neural Scene Reconstruction

Structured-NeRF: Hierarchical Scene Graph with Neural Representation

Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Grids

Indoor Scene Reconstruction with Fine-Grained Details Using Hybrid Representation and Normal Prior Enhancement