Abstract:Face photo–sketch synthesis aims at generating a facial sketch/photo conditioned on a given photo/sketch. It covers wide applications including digital entertainment and law enforcement. Precisely depicting face photos/sketches remains challenging due to the restrictions on structural realism and textural consistency. While existing methods achieve compelling results, they mostly yield blurred effects and great deformation over various facial components, leading to the unrealistic feeling of synthesized images. To tackle this challenge, in this article, we propose using facial composition information to help the synthesis of face sketch/photo. Especially, we propose a novel composition-aided generative adversarial network (CA-GAN) for face photo–sketch synthesis. In CA-GAN, we utilize paired inputs, including a face photo/sketch and the corresponding pixelwise face labels for generating a sketch/photo. Next, to focus training on hard-generated components and delicate facial structures, we propose a compositional reconstruction loss. In addition, we employ a perceptual loss function to encourage the synthesized image and real image to be perceptually similar. Finally, we use stacked CA-GANs (SCA-GANs) to further rectify defects and add compelling details. The experimental results show that our method is capable of generating both visually comfortable and identity-preserving face sketches/photos over a wide range of challenging data. In addition, our method significantly decreases the best previous Fréchet inception distance (FID) from 36.2 to 26.2 for sketch synthesis, and from 60.9 to 30.5 for photo synthesis. Besides, we demonstrate that the proposed method is of considerable generalization ability.

Guided Face Cartoon Synthesis.

Face Cartoon Synthesis Based on the Active Appearance Model

Cartoon Face Synthesis Based on Markov Network

Structure-Preserved Face Cartoonization

Composition-Aided Face Photo-Sketch Synthesis.

Synthesis, Style Editing, and Animation of 3D Cartoon Face

Towards Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs

Retrieval Based Cartoon Synthesis Via Heterogeneous Features Learning

Toward Realistic Face Photo–Sketch Synthesis via Composition-Aided GANs

A Face Cartoon Producer for Digital Content Service

Performance-Driven Animation of Hand-Drawn Cartoon Faces

Cartoon Synthesis Using Constrained Spreading Activation Network

Creative cartoon face synthesis system for mobile entertainment

Unpaired Cartoon Image Synthesis Via Gated Cycle Mapping

Biphasic Face Photo-Sketch Synthesis via Semantic-Driven Generative Adversarial Network with Graph Representation Learning

Face sketch-to-photo synthesis from simple line drawing.

An experimental facial synthesis system using graph cut and gradient domain fusion

GC-GAN: Photo Cartoonization Using Guided Cartoon Generative Adversarial Network

Perspective-aware Cartoon Clips Synthesis

Image-based facial sketch-to-photo synthesis via online coupled dictionary learning

Few-Shot Knowledge Transfer for Fine-Grained Cartoon Face Generation