Abstract:High-fidelity digital human representations are increasingly in demand in the digital world, particularly for interactive telepresence, AR/VR, 3D graphics, and the rapidly evolving metaverse. Even though they work well in small spaces, conventional methods for reconstructing 3D human motion frequently require the use of expensive hardware and have high processing costs. This study presents HumanAvatar, an innovative approach that efficiently reconstructs precise human avatars from monocular video sources. At the core of our methodology, we integrate the pre-trained HuMoR, a model celebrated for its proficiency in human motion estimation. This is adeptly fused with the cutting-edge neural radiance field technology, Instant-NGP, and the state-of-the-art articulated model, Fast-SNARF, to enhance the reconstruction fidelity and speed. By combining these two technologies, a system is created that can render quickly and effectively while also providing estimation of human pose parameters that are unmatched in accuracy. We have enhanced our system with an advanced posture-sensitive space reduction technique, which optimally balances rendering quality with computational efficiency. In our detailed experimental analysis using both artificial and real-world monocular videos, we establish the advanced performance of our approach. HumanAvatar consistently equals or surpasses contemporary leading-edge reconstruction techniques in quality. Furthermore, it achieves these complex reconstructions in minutes, a fraction of the time typically required by existing methods. Our models achieve a training speed that is 110X faster than that of State-of-The-Art (SoTA) NeRF-based models. Our technique performs noticeably better than SoTA dynamic human NeRF methods if given an identical runtime limit. HumanAvatar can provide effective visuals after only 30 seconds of training.

HAIFAI: Human-AI Collaboration for Mental Face Reconstruction

Neural Photofit: Gaze-based Mental Image Reconstruction

SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Video

Efficient Neural Implicit Representation for 3D Human Reconstruction

Multiface: A Dataset for Neural Face Rendering

R2Human: Real-Time 3D Human Appearance Rendering from a Single Image

HiFace: High-Fidelity 3D Face Reconstruction by Learning Static and Dynamic Details

Fake It Without Making It: Conditioned Face Generation for Accurate 3D Face Reconstruction

High-Fidelity Human Avatars from a Single RGB Camera

HAVE-FUN: Human Avatar Reconstruction from Few-Shot Unconstrained Images

High-Fidelity 3D Digital Human Head Creation from RGB-D Selfies

TIFace: Improving Facial Reconstruction through Tensorial Radiance Fields and Implicit Surfaces

Controllable One-shot Head Avatar Reconstruction

HAIFIT: Human-to-AI Fashion Image Translation

CNN-Based Real-Time Dense Face Reconstruction with Inverse-Rendered Photo-Realistic Face Images.

Arc2Face: A Foundation Model for ID-Consistent Human Faces

AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild"

REALY: Rethinking the Evaluation of 3D Face Reconstruction.

3DFaceNet: Real-time Dense Face Reconstruction via Synthesizing Photo-realistic Face Images

FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction

Joint 3d Face Reconstruction And Dense Face Alignment Via Deep Face Feature Alignment