Abstract:Recent advances in single-view 3D hair digitization have made the creation of high-quality CG characters scalable and accessible to end-users, enabling new forms of personalized VR and gaming experiences. To handle the complexity and variety of hair structures, most cutting-edge techniques rely on the successful retrieval of a particular hair model from a comprehensive hair database. Not only are the aforementioned data-driven methods storage intensive, but they are also prone to failure for highly unconstrained input images, complicated hairstyles, and failed face detection. Instead of using a large collection of 3D hair models directly, we propose to represent the manifold of 3D hairstyles implicitly through a compact latent space of a volumetric variational autoencoder (VAE). This deep neural network is trained with volumetric orientation field representations of 3D hair models and can synthesize new hairstyles from a compressed code. To enable end-to-end 3D hair inference, we train an additional embedding network to predict the code in the VAE latent space from any input image. Strand-level hairstyles can then be generated from the predicted volumetric representation. Our fully automatic framework does not require any ad-hoc face fitting, intermediate classification and segmentation, or hairstyle database retrieval. Our hair synthesis approach is significantly more robust and can handle a much wider variation of hairstyles than state-of-the-art data-driven hair modeling techniques with challenging inputs, including photos that are low-resolution, overexposured, or contain extreme head poses. The storage requirements are minimal and a 3D hair model can be produced from an image in a second. Our evaluations also show that successful reconstructions are possible from highly stylized cartoon images, non-human subjects, and pictures taken from behind a person. Our approach is particularly well suited for continuous and plausible hair interpolation between very different hairstyles.

Quaffure: Real-Time Quasi-Static Neural Hair Simulation

Real-Time Hair Simulation With Neural Interpolation

CT2Hair: High-Fidelity 3D Hair Modeling Using Computed Tomography.

NeuWigs: A Neural Dynamic Model for Volumetric Hair Capture and Animation

HVH: Learning a Hybrid Neural Volumetric Representation for Dynamic Hair Performance Capture

A Reduced Model for Interactive Hairs.

Neural Haircut: Prior-Guided Strand-Based Hair Reconstruction

HHAvatar: Gaussian Head Avatar with Dynamic Hairs

HairNet: Single-View Hair Reconstruction using Convolutional Neural Networks

Real-time Physically Guided Hair Interpolation

Neural Strands: Learning Hair Geometry and Appearance from Multi-View Images

SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing

Intuitive, Interactive Beard and Hair Synthesis with Generative Models

HAAR: Text-Conditioned Generative Model of 3D Strand-based Human Hairstyles

3D hair synthesis using volumetric variational autoencoders

Avatar digitization from a single image for real-time rendering

Real-time Hair Simulation with Heptadiagonal Decomposition on Mass Spring System

Dynamic Hair Manipulation in Images and Videos

MonoHair: High-Fidelity Hair Modeling from a Monocular Video

StrandHead: Text to Strand-Disentangled 3D Head Avatars Using Hair Geometric Priors

GaussianHair: Hair Modeling and Rendering with Light-aware Gaussians