Abstract:Recent advances in single-view 3D hair digitization have made the creation of high-quality CG characters scalable and accessible to end-users, enabling new forms of personalized VR and gaming experiences. To handle the complexity and variety of hair structures, most cutting-edge techniques rely on the successful retrieval of a particular hair model from a comprehensive hair database. Not only are the aforementioned data-driven methods storage intensive, but they are also prone to failure for highly unconstrained input images, complicated hairstyles, and failed face detection. Instead of using a large collection of 3D hair models directly, we propose to represent the manifold of 3D hairstyles implicitly through a compact latent space of a volumetric variational autoencoder (VAE). This deep neural network is trained with volumetric orientation field representations of 3D hair models and can synthesize new hairstyles from a compressed code. To enable end-to-end 3D hair inference, we train an additional embedding network to predict the code in the VAE latent space from any input image. Strand-level hairstyles can then be generated from the predicted volumetric representation. Our fully automatic framework does not require any ad-hoc face fitting, intermediate classification and segmentation, or hairstyle database retrieval. Our hair synthesis approach is significantly more robust and can handle a much wider variation of hairstyles than state-of-the-art data-driven hair modeling techniques with challenging inputs, including photos that are low-resolution, overexposured, or contain extreme head poses. The storage requirements are minimal and a 3D hair model can be produced from an image in a second. Our evaluations also show that successful reconstructions are possible from highly stylized cartoon images, non-human subjects, and pictures taken from behind a person. Our approach is particularly well suited for continuous and plausible hair interpolation between very different hairstyles.

Real-Time Hair Simulation With Neural Interpolation

CT2Hair: High-Fidelity 3D Hair Modeling Using Computed Tomography.

Ihair Recolorer: Deep Image-to-video Hair Color Transfer

Real-time Physically Guided Hair Interpolation

Quaffure: Real-Time Quasi-Static Neural Hair Simulation

HairNet: Single-View Hair Reconstruction using Convolutional Neural Networks

A Reduced Model for Interactive Hairs.

HVH: Learning a Hybrid Neural Volumetric Representation for Dynamic Hair Performance Capture

Hair-GAN: Recovering 3D Hair Structure from a Single Image Using Generative Adversarial Networks

Neural Strands: Learning Hair Geometry and Appearance from Multi-View Images

NeuWigs: A Neural Dynamic Model for Volumetric Hair Capture and Animation

Intuitive, Interactive Beard and Hair Synthesis with Generative Models

Neural Haircut: Prior-Guided Strand-Based Hair Reconstruction

Hair Interpolation for Portrait Morphing.

Dynamic Hair Manipulation in Images and Videos

Real-time Facial Animation with Image-Based Dynamic Avatars.

3D hair synthesis using volumetric variational autoencoders

GaussianHair: Hair Modeling and Rendering with Light-aware Gaussians

Real-time Hair Simulation with Heptadiagonal Decomposition on Mass Spring System

Adaptive Skinning for Interactive Hair-Solid Simulation.

Dynamic Hair Modeling from Monocular Videos Using Deep Neural Networks