Abstract:In this paper, we present a generative sketch model for human hair analysis and synthesis. We treat hair images as 2D piecewise smooth vector (flow) fields and, thus, our representation is view-based in contrast to the physically-based 3D hair models in graphics. The generative model has three levels. The bottom level is the high-frequency band of the hair image. The middle level is a piecewise smooth vector field for the hair orientation, gradient strength, and growth directions. The top level is an attribute sketch graph for representing the discontinuities in the vector field. A sketch graph typically has a number of sketch curves which are divided into 11 types of directed primitives. Each primitive is a small window (say 5 x 7 pixels) where the orientations and growth directions are defined in parametric forms, for example, hair boundaries, occluding lines between hair strands, dividing lines on top of the hair, etc. In addition to the three level representation, we model the shading effects, i.e., the low-frequency band of the hair image, by a linear superposition of some Gaussian image bases and we encode the hair color by a color map. The inference algorithm is divided into two stages: 1) We compute the undirected orientation field and sketch graph from an input image and 2) we compute the hair growth direction forthe sketch curves and the orientation field using a Swendsen-Wang cut algorithm. Both steps maximize a joint Bayesian posterior probability. The generative model provides a straightforward way for synthesizing realistic hair images and stylistic drawings (rendering) from a sketch graph and a few Gaussian bases. The latter can be either inferred from a real hair image or input (edited) manually using a simple sketching interface. We test our algorithm on a large data set of hair images with diverse hair styles. Analysis, synthesis, and rendering results are reported in the experiments.

What are good parts for hair shape modeling?

Struct2Hair: A Hair Shape Descriptor for Hairstyle Modeling.

Combining Local and Global Information for Hair Shape Modeling

A Compositional Exemplar-Based Model For Hair Segmentation

Recurring Part Arrangements in Shape Collections

Hair-GAN: Recovering 3D Hair Structure from a Single Image Using Generative Adversarial Networks

Image-Based Hair Pre-processing for Art Creation: A Case Study of Bas-Relief Modelling

CT2Hair: High-Fidelity 3D Hair Modeling Using Computed Tomography.

A Semantic Parametric Model for 3D Human Body Reshaping.

Modeling Hair from an RGB-D Camera.

A Generative Model of Human Hair for Hair Sketching

High-quality hair modeling from a single portrait photo

GroomGen: A High-Quality Generative Hair Model Using Hierarchical Latent Representations

Hair Style Retrieval by Semantic Mapping on Informative Patches

A Novel Coarse-to-fine Hair Segmentation Method.

Perm: A Parametric Representation for Multi-Style 3D Hair Modeling

Realistic Human Head Modeling with Hairstyle Reconstruction

Learning to regulate 3D head shape by removing occluding hair from in-the-wild images

Example-based Hair Geometry Synthesis.

A generative sketch model for human hair analysis and synthesis.

Robust Human Body Segmentation Based on Part Appearance and Spatial Constraint