Abstract: Recent methods for dynamic human reconstruction have attained promising reconstruction results. Most of these methods rely only on RGB color supervision without considering explicit geometric constraints. This leads to existing human reconstruction techniques being more prone to overfitting to color and causes geometrically inherent ambiguities, especially in the sparse multi-view setup. Motivated by recent advances in the field of monocular geometry prediction, we consider the geometric constraints of estimated depth and normals in the learning of neural implicit representation for dynamic human reconstruction. As a geometric regularization, this provides reliable yet explicit supervision information, and improves reconstruction quality. We also exploit several beneficial physical priors, such as adding noise into view direction and maximizing the density on the human surface. These priors ensure the color rendered along rays to be robust to view direction and reduce the inherent ambiguities of density estimated along rays. Experimental results demonstrate that depth and normal cues, predicted by human-specific monocular estimators, can provide effective supervision signals and render more accurate images. Finally, we also show that the proposed physical priors significantly reduce overfitting and improve the overall quality of novel view synthesis. Our code is available at:~\href{https://github.com/PRIS-CV/HumanRecon}{https://github.com/PRIS-CV/HumanRecon}.

GP-Recon: Online Monocular Neural 3D Reconstruction with Geometric Prior.

MonoNeuralFusion: Online Monocular Neural 3D Reconstruction with Geometric Priors

Georecon: a coarse-to-fine visual 3D reconstruction approach for high-resolution images with neural matching priors

NeuralRecon: Real-Time Coherent 3D Scene Reconstruction from Monocular Video

NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video.

HumanRecon: Neural Reconstruction of Dynamic Human Using Geometric Cues and Physical Priors.

DGNS: Deformable Gaussian Splatting and Dynamic Neural Surface for Monocular Dynamic 3D Reconstruction

PointRecon: Online Point-based 3D Reconstruction via Ray-based 2D-3D Matching

Neural 3D reconstruction from sparse views using geometric priors

Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splatting

Real-time Underwater 3D Reconstruction Based on Monocular Image

Neural 3D Reconstruction in the Wild

PanoRecon: Real-Time Panoptic 3D Reconstruction from Monocular Video

High-fidelity Facial Avatar Reconstruction from Monocular Video with Generative Priors

Fine-detailed Neural Indoor Scene Reconstruction using multi-level importance sampling and multi-view consistency

Evaluating Modern Approaches in 3D Scene Reconstruction: NeRF vs Gaussian-Based Methods

Neural 3D Scene Reconstruction with Indoor Planar Priors

Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Grids

FineRecon: Depth-aware Feed-forward Network for Detailed 3D Reconstruction

EPRecon: An Efficient Framework for Real-Time Panoptic 3D Reconstruction from Monocular Video

Indoor Scene Reconstruction From Monocular Video Combining Contextual and Geometric Priors