Abstract:In this paper, we present a generative sketch model for human hair analysis and synthesis. We treat hair images as 2D piecewise smooth vector (flow) fields and, thus, our representation is view-based in contrast to the physically-based 3D hair models in graphics. The generative model has three levels. The bottom level is the high-frequency band of the hair image. The middle level is a piecewise smooth vector field for the hair orientation, gradient strength, and growth directions. The top level is an attribute sketch graph for representing the discontinuities in the vector field. A sketch graph typically has a number of sketch curves which are divided into 11 types of directed primitives. Each primitive is a small window (say 5 x 7 pixels) where the orientations and growth directions are defined in parametric forms, for example, hair boundaries, occluding lines between hair strands, dividing lines on top of the hair, etc. In addition to the three level representation, we model the shading effects, i.e., the low-frequency band of the hair image, by a linear superposition of some Gaussian image bases and we encode the hair color by a color map. The inference algorithm is divided into two stages: 1) We compute the undirected orientation field and sketch graph from an input image and 2) we compute the hair growth direction forthe sketch curves and the orientation field using a Swendsen-Wang cut algorithm. Both steps maximize a joint Bayesian posterior probability. The generative model provides a straightforward way for synthesizing realistic hair images and stylistic drawings (rendering) from a sketch graph and a few Gaussian bases. The latter can be either inferred from a real hair image or input (edited) manually using a simple sketching interface. We test our algorithm on a large data set of hair images with diverse hair styles. Analysis, synthesis, and rendering results are reported in the experiments.

Example-based Hair Geometry Synthesis.

Struct2Hair: A Hair Shape Descriptor for Hairstyle Modeling.

CT2Hair: High-Fidelity 3D Hair Modeling Using Computed Tomography.

Image-Based Hair Pre-processing for Art Creation: A Case Study of Bas-Relief Modelling

Hair-GAN: Recovering 3D Hair Structure from a Single Image Using Generative Adversarial Networks

A generative sketch model for human hair analysis and synthesis.

GroomGen: A High-Quality Generative Hair Model Using Hierarchical Latent Representations

Dynamic Hair Manipulation in Images and Videos

GaussianHair: Hair Modeling and Rendering with Light-aware Gaussians

Hair Interpolation for Portrait Morphing.

Real-time Physically Guided Hair Interpolation

Modeling Hair from an RGB-D Camera.

A Generative Model of Human Hair for Hair Sketching

Ihair Recolorer: Deep Image-to-video Hair Color Transfer

SketchHairSalon: Deep Sketch-based Hair Image Synthesis

HairNet: Single-View Hair Reconstruction using Convolutional Neural Networks

Human Hair Reconstruction with Strand-Aligned 3D Gaussians

A Generative Sketch Model for Human Hair Analysis and Synthesis

HairStep: Transfer Synthetic to Real Using Strand and Depth Maps for Single-View 3D Hair Modeling

Cartoon Hair Generation by Combining Geometric Kinematics

Towards Unified 3D Hair Reconstruction from Single-View Portraits