Abstract:Recent deep generative models allow real-time generation of hair images from sketch inputs. Existing solutions often require a user-provided binary mask to specify a target hair shape. This not only costs users extra labor but also fails to capture complicated hair boundaries. Those solutions usually encode hair structures via orientation maps, which, however, are not very effective to encode complex structures. We observe that colored hair sketches already implicitly define target hair shapes as well as hair appearance and are more flexible to depict hair structures than orientation maps. Based on these observations, we present SketchHairSalon, a two-stage framework for generating realistic hair images directly from freehand sketches depicting desired hair structure and appearance. At the first stage, we train a network to predict a hair matte from an input hair sketch, with an optional set of non-hair strokes. At the second stage, another network is trained to synthesize the structure and appearance of hair images from the input sketch and the generated matte. To make the networks in the two stages aware of long-term dependency of strokes, we apply self-attention modules to them. To train these networks, we present a new dataset containing thousands of annotated hair sketch-image pairs and corresponding hair mattes. Two efficient methods for sketch completion are proposed to automatically complete repetitive braided parts and hair strokes, respectively, thus reducing the workload of users. Based on the trained networks and the two sketch completion strategies, we build an intuitive interface to allow even novice users to design visually pleasing hair images exhibiting various hair structures and appearance via freehand sketches. The qualitative and quantitative evaluations show the advantages of the proposed system over the existing or alternative solutions.

A Simple Framework For Face Photo-Sketch Synthesis

A synthesis method for personalized 3D face reconstruction

Face sketch-to-photo synthesis from simple line drawing.

Multiple Representations-Based Face Sketch–Photo Synthesis

Sketch realizing: Lifelike portrait synthesis from sketch

Face Sketch-Photo Synthesis under Multi-dictionary Sparse Representation Framework

Unsupervised Scene Sketch to Photo Synthesis

Face Photo Sketch Synthesis via Larger Patch and Multiresolution Spline

Face Sketch–Photo Synthesis and Retrieval Using Sparse Representation

A modality separation approach for facial sketch synthesis

Deep Generation of Face Images from Sketches

Face photo-sketch synthesis via full-scale identity supervision

Image-based facial sketch-to-photo synthesis via online coupled dictionary learning

An experimental facial synthesis system using graph cut and gradient domain fusion

Dual-Transfer Face Sketch-Photo Synthesis

Composition-Aided Face Photo-Sketch Synthesis.

Biphasic Face Photo-Sketch Synthesis via Semantic-Driven Generative Adversarial Network with Graph Representation Learning

SketchHairSalon: Deep Sketch-based Hair Image Synthesis

Toward Realistic Face Photo–Sketch Synthesis via Composition-Aided GANs

Image based Face Sketch-to-Photo via Online Coupled Dictionary Learning

A new approach for face recognition by sketches in photos