Abstract:Face portrait line drawing is a unique style of art which is highly abstract and expressive. However, due to its high semantic constraints, many existing methods learn to generate portrait drawings using paired training data, which is costly and time-consuming to obtain. In this paper, we propose a novel method to automatically transform face photos to portrait drawings using unpaired training data with two new features; i.e., our method can (1) learn to generate high quality portrait drawings in multiple styles using a single network and (2) generate portrait drawings in a "new style" unseen in the training data. To achieve these benefits, we (1) propose a novel quality metric for portrait drawings which is learned from human perception, and (2) introduce a quality loss to guide the network toward generating better looking portrait drawings. We observe that existing unpaired translation methods such as CycleGAN tend to embed invisible reconstruction information indiscriminately in the whole drawings due to significant information imbalance between the photo and portrait drawing domains, which leads to important facial features missing. To address this problem, we propose a novel asymmetric cycle mapping that enforces the reconstruction information to be visible and only embedded in the selected facial regions. Along with localized discriminators for important facial regions, our method well preserves all important facial features in the generated drawings. Generator dissection further explains that our model learns to incorporate face semantic information during drawing generation. Extensive experiments including a user study show that our model outperforms state-of-the-art methods.

Joint-domain Unsupervised Stylization for Portraits

Automatic Portrait Oil Painter: Joint Domain Stylization for Portrait Images

Feature-Based Automatic Portrait Generation System

Hierarchical Oil Painting Stylization with Limited Reference Via Sparse Representation.

Portrait Diffusion: Training-free Face Stylization with Chain-of-Painting

Realtime Fewshot Portrait Stylization Based On Geometric Alignment

A Free Viewpoint Portrait Generator with Dynamic Styling.

DeepPortraitDrawing: Generating human body images from freehand sketches

Sketch-to-Art: Synthesizing Stylized Art Images From Sketches

Sketch realizing: Lifelike portrait synthesis from sketch

Portrait-Aware Artistic Style Transfer.

Artistic stylization of face photos based on a single exemplar

Learning Portrait Style Representations

3Dtoonify: Creating Your High-Fidelity 3D Stylized Avatar Easily from 2D Portrait Images

Make Your Brief Stroke Real and Stereoscopic: 3D-Aware Simplified Sketch to Portrait Generation

Example-based Automatic Portraiture

Synthesizing Oil Painting Surface Geometry from a Single Photograph

ZePo: Zero-Shot Portrait Stylization with Faster Sampling

Enhancing the Authenticity of Rendered Portraits with Identity-Consistent Transfer Learning

Unpaired Portrait Drawing Generation Via Asymmetric Cycle Mapping.

Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Data