Abstract:Face portrait line drawing is a unique style of art which is highly abstract and expressive. However, due to its high semantic constraints, many existing methods learn to generate portrait drawings using paired training data, which is costly and time-consuming to obtain. In this paper, we propose a novel method to automatically transform face photos to portrait drawings using unpaired training data with two new features; i.e., our method can (1) learn to generate high quality portrait drawings in multiple styles using a single network and (2) generate portrait drawings in a "new style" unseen in the training data. To achieve these benefits, we (1) propose a novel quality metric for portrait drawings which is learned from human perception, and (2) introduce a quality loss to guide the network toward generating better looking portrait drawings. We observe that existing unpaired translation methods such as CycleGAN tend to embed invisible reconstruction information indiscriminately in the whole drawings due to significant information imbalance between the photo and portrait drawing domains, which leads to important facial features missing. To address this problem, we propose a novel asymmetric cycle mapping that enforces the reconstruction information to be visible and only embedded in the selected facial regions. Along with localized discriminators for important facial regions, our method well preserves all important facial features in the generated drawings. Generator dissection further explains that our model learns to incorporate face semantic information during drawing generation. Extensive experiments including a user study show that our model outperforms state-of-the-art methods.

PLDGAN: portrait line drawing generation with prior knowledge and conditioning target

Apdrawinggan: Generating Artistic Portrait Drawings From Face Photos With Hierarchical Gans

Attack Deterministic Conditional Image Generative Models for Diverse and Controllable Generation

Feature-Based Automatic Portrait Generation System

Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Data

Line Drawings for Face Portraits from Photos Using Global and Local Structure Based GANs

RefFaceNet: Reference-based Face Image Generation from Line Art Drawings

General Virtual Sketching Framework for Vector Line Art

Joint Geometric-Semantic Driven Character Line Drawing Generation

SmartPaint: a Co-Creative Drawing System Based on Generative Adversarial Networks

DrawingInStyles: Portrait Image Generation and Editing with Spatially Conditioned StyleGAN

Generating Artistic Portraits from Face Photos with Feature Disentanglement and Reconstruction

Self-driven Dual-path Learning for Reference-based Line Art Colorization under Limited Data

Animating Portrait Line Drawings from a Single Face Photo and a Speech Signal

Flexible Portrait Image Editing with Fine-Grained Control

LinesToFacePhoto

Mask-Guided Portrait Editing With Conditional GANs

GAN-based AI Drawing Board for Image Generation and Colorization

3DFaceShop: Explicitly Controllable 3D-Aware Portrait Generation

DRAWING WITH BOTS: HUMAN-COMPUTER COL-LABORATIVE DRAWING EXPERIMENTS

Face photo-line drawings synthesis based on local extraction preserving generative adversarial networks