Abstract:Recent deep generative models allow real-time generation of hair images from sketch inputs. Existing solutions often require a user-provided binary mask to specify a target hair shape. This not only costs users extra labor but also fails to capture complicated hair boundaries. Those solutions usually encode hair structures via orientation maps, which, however, are not very effective to encode complex structures. We observe that colored hair sketches already implicitly define target hair shapes as well as hair appearance and are more flexible to depict hair structures than orientation maps. Based on these observations, we present SketchHairSalon, a two-stage framework for generating realistic hair images directly from freehand sketches depicting desired hair structure and appearance. At the first stage, we train a network to predict a hair matte from an input hair sketch, with an optional set of non-hair strokes. At the second stage, another network is trained to synthesize the structure and appearance of hair images from the input sketch and the generated matte. To make the networks in the two stages aware of long-term dependency of strokes, we apply self-attention modules to them. To train these networks, we present a new dataset containing thousands of annotated hair sketch-image pairs and corresponding hair mattes. Two efficient methods for sketch completion are proposed to automatically complete repetitive braided parts and hair strokes, respectively, thus reducing the workload of users. Based on the trained networks and the two sketch completion strategies, we build an intuitive interface to allow even novice users to design visually pleasing hair images exhibiting various hair structures and appearance via freehand sketches. The qualitative and quantitative evaluations show the advantages of the proposed system over the existing or alternative solutions.

Cali-sketch: Stroke calibration and completion for high-quality face image generation from human-like sketches

Face Sketch Landmarks Localization in the Wild

Realistic Sketch Face Generation Via Sketch-Guided Incomplete Restoration

Sketch-R2CNN: an Attentive Network for Vector Sketch Recognition

DeepFacePencil: Creating Face Images from Freehand Sketches.

Sketch realizing: Lifelike portrait synthesis from sketch

Deep Generation of Face Images from Sketches

End-to-End Photo-Sketch Generation via Fully Convolutional Representation Learning

Face photo-sketch synthesis via full-scale identity supervision

Towards Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs

Composition-Aided Face Photo-Sketch Synthesis.

HCGAN: hierarchical contrast generative adversarial network for unpaired sketch face synthesis

Quality Guided Sketch-to-Photo Image Synthesis

Learning to Sketch Human Facial Portraits Using Personal Styles by Case-Based Reasoning

Controllable Sketch-to-Image Translation for Robust Face Synthesis

Face Sketch Synthesis via Semantic-Driven Generative Adversarial Network

Automatic Image-Based Pencil Sketch Rendering

Face sketch-to-photo synthesis from simple line drawing.

Toward Realistic Face Photo–Sketch Synthesis via Composition-Aided GANs

Face Photo Sketch Synthesis via Larger Patch and Multiresolution Spline

SketchHairSalon: Deep Sketch-based Hair Image Synthesis