Abstract:In this paper, we present a generative sketch model for human hair analysis and synthesis. We treat hair images as 2D piecewise smooth vector (flow) fields and, thus, our representation is view-based in contrast to the physically-based 3D hair models in graphics. The generative model has three levels. The bottom level is the high-frequency band of the hair image. The middle level is a piecewise smooth vector field for the hair orientation, gradient strength, and growth directions. The top level is an attribute sketch graph for representing the discontinuities in the vector field. A sketch graph typically has a number of sketch curves which are divided into 11 types of directed primitives. Each primitive is a small window (say 5 x 7 pixels) where the orientations and growth directions are defined in parametric forms, for example, hair boundaries, occluding lines between hair strands, dividing lines on top of the hair, etc. In addition to the three level representation, we model the shading effects, i.e., the low-frequency band of the hair image, by a linear superposition of some Gaussian image bases and we encode the hair color by a color map. The inference algorithm is divided into two stages: 1) We compute the undirected orientation field and sketch graph from an input image and 2) we compute the hair growth direction forthe sketch curves and the orientation field using a Swendsen-Wang cut algorithm. Both steps maximize a joint Bayesian posterior probability. The generative model provides a straightforward way for synthesizing realistic hair images and stylistic drawings (rendering) from a sketch graph and a few Gaussian bases. The latter can be either inferred from a real hair image or input (edited) manually using a simple sketching interface. We test our algorithm on a large data set of hair images with diverse hair styles. Analysis, synthesis, and rendering results are reported in the experiments.

DeepSketchHair: Deep Sketch-Based 3D Hair Modeling

SketchHairSalon: Deep Sketch-based Hair Image Synthesis

Struct2Hair: A Hair Shape Descriptor for Hairstyle Modeling.

CT2Hair: High-Fidelity 3D Hair Modeling Using Computed Tomography.

Hair-GAN: Recovering 3D Hair Structure from a Single Image Using Generative Adversarial Networks

A generative sketch model for human hair analysis and synthesis.

HairNet: Single-View Hair Reconstruction using Convolutional Neural Networks

Sketchformer++: A Hierarchical Transformer Architecture for Vector Sketch Representation

Deep3DSketch+: Obtaining Customized 3D Model by Single Free-Hand Sketch through Deep Learning

Deep3DSketch+\+: High-Fidelity 3D Modeling from Single Free-hand Sketches

DeepMVSHair: Deep Hair Modeling from Sparse Views.

A Generative Sketch Model for Human Hair Analysis and Synthesis

Rapid 3D Model Generation with Intuitive 3D Input

A Generative Model of Human Hair for Hair Sketching

Deep3DSketch+: Rapid 3D Modeling from Single Free-hand Sketches

High-Fidelity 3D Model Generation with Relightable Appearance from Single Freehand Sketches and Text Guidance

Deep3DSketch-im: rapid high-fidelity AI 3D model generation by single freehand sketches

AutoHair: fully automatic hair modeling from a single image.

NeuralHDHair: Automatic High-fidelity Hair Modeling from a Single Image Using Implicit Neural Representations

Dynamic Hair Modeling from Monocular Videos Using Deep Neural Networks

Modeling Hair from an RGB-D Camera.