Abstract:Face portrait line drawing is a unique style of art which is highly abstract and expressive. However, due to its high semantic constraints, many existing methods learn to generate portrait drawings using paired training data, which is costly and time-consuming to obtain. In this paper, we propose a novel method to automatically transform face photos to portrait drawings using unpaired training data with two new features; i.e., our method can (1) learn to generate high quality portrait drawings in multiple styles using a single network and (2) generate portrait drawings in a "new style" unseen in the training data. To achieve these benefits, we (1) propose a novel quality metric for portrait drawings which is learned from human perception, and (2) introduce a quality loss to guide the network toward generating better looking portrait drawings. We observe that existing unpaired translation methods such as CycleGAN tend to embed invisible reconstruction information indiscriminately in the whole drawings due to significant information imbalance between the photo and portrait drawing domains, which leads to important facial features missing. To address this problem, we propose a novel asymmetric cycle mapping that enforces the reconstruction information to be visible and only embedded in the selected facial regions. Along with localized discriminators for important facial regions, our method well preserves all important facial features in the generated drawings. Generator dissection further explains that our model learns to incorporate face semantic information during drawing generation. Extensive experiments including a user study show that our model outperforms state-of-the-art methods.

Facial Pixel Drawing Generation Algorithm

Feature-Based Automatic Portrait Generation System

A real-time interactive system for facial makeup of Peking Opera

Automatic Generation of Pen-and-ink Drawings from Photos.

An Art-Oriented Pixelation Method for Cartoon Images

PencilArt: A Chromatic Penciling Style Generation Framework.

Automatic Image-Based Pencil Sketch Rendering

Automatic Cartoon Face Generation Based on SVG

An Example-Based Facial Sketch Generation System

Example-Based Facial Sketch Generation With Non-Parametric Sampling

An experimental facial synthesis system using graph cut and gradient domain fusion

A Robot Portraits Pencil Sketching Algorithm Based on Face Component and Texture Segmentation

RefFaceNet: Reference-based Face Image Generation from Line Art Drawings

A Face Cartoon Producer for Digital Content Service

Facial Sketch Rendering and Animation for Fun Communications.

An Adaptive Multi-Pixel Line Drawing Algorithm Based on Displacement Code

Performance-Driven Animation of Hand-Drawn Cartoon Faces

A Facial Sketch Animation Generator for Mobile Communication

Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Data

A Stylized Method for Facial Cartoon Based on Feature Tracking and Rending

Face sketch-to-photo synthesis from simple line drawing.