Abstract:High-fidelity digital human representations are increasingly in demand in the digital world, particularly for interactive telepresence, AR/VR, 3D graphics, and the rapidly evolving metaverse. Even though they work well in small spaces, conventional methods for reconstructing 3D human motion frequently require the use of expensive hardware and have high processing costs. This study presents HumanAvatar, an innovative approach that efficiently reconstructs precise human avatars from monocular video sources. At the core of our methodology, we integrate the pre-trained HuMoR, a model celebrated for its proficiency in human motion estimation. This is adeptly fused with the cutting-edge neural radiance field technology, Instant-NGP, and the state-of-the-art articulated model, Fast-SNARF, to enhance the reconstruction fidelity and speed. By combining these two technologies, a system is created that can render quickly and effectively while also providing estimation of human pose parameters that are unmatched in accuracy. We have enhanced our system with an advanced posture-sensitive space reduction technique, which optimally balances rendering quality with computational efficiency. In our detailed experimental analysis using both artificial and real-world monocular videos, we establish the advanced performance of our approach. HumanAvatar consistently equals or surpasses contemporary leading-edge reconstruction techniques in quality. Furthermore, it achieves these complex reconstructions in minutes, a fraction of the time typically required by existing methods. Our models achieve a training speed that is 110X faster than that of State-of-The-Art (SoTA) NeRF-based models. Our technique performs noticeably better than SoTA dynamic human NeRF methods if given an identical runtime limit. HumanAvatar can provide effective visuals after only 30 seconds of training.

InceptionHuman: Controllable Prompt-to-NeRF for Photorealistic 3D Human Generation

MPS-NeRF: Generalizable 3D Human Rendering from Multiview Images

Neural Capture of Animatable 3D Human from Monocular Video.

HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion

ReN Human: Learning Relightable Neural Implicit Surfaces for Animatable Human Rendering

HumanNeRF-SE: A Simple yet Effective Approach to Animate HumanNeRF with Diverse Poses

Single-Image 3D Human Digitization with Shape-Guided Diffusion

HDHumans: A Hybrid Approach for High-fidelity Digital Humans

3D-Aware Semantic-Guided Generative Model for Human Synthesis.

R2Human: Real-Time 3D Human Appearance Rendering from a Single Image

HumanGen: Generating Human Radiance Fields with Explicit Priors

Inpaint4DNeRF: Promptable Spatio-Temporal NeRF Inpainting with Generative Diffusion Models

EG-HumanNeRF: Efficient Generalizable Human NeRF Utilizing Human Prior for Sparse View

FaceDNeRF: Semantics-Driven Face Reconstruction, Prompt Editing and Relighting with Diffusion Models

DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humans

CapHuman: Capture Your Moments in Parallel Universes

Efficient Neural Implicit Representation for 3D Human Reconstruction

AirNeRF: 3D Reconstruction of Human with Drone and NeRF for Future Communication Systems

Human 3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models

HeadNeRF: A Real-time NeRF-based Parametric Head Model

EVA3D: Compositional 3D Human Generation from 2D Image Collections