Abstract:Biphasic face photo-sketch synthesis has significant practical value in wide-ranging fields such as digital entertainment and law enforcement. Previous approaches directly generate the photo-sketch in a global view, they always suffer from the low quality of sketches and complex photo variations, leading to unnatural and low-fidelity results. In this paper, we propose a novel Semantic-Driven Generative Adversarial Network to address the above issues, cooperating with Graph Representation Learning. Considering that human faces have distinct spatial structures, we first inject class-wise semantic layouts into the generator to provide style-based spatial information for synthesized face photos and sketches. Additionally, to enhance the authenticity of details in generated faces, we construct two types of representational graphs via semantic parsing maps upon input faces, dubbed the IntrA-class Semantic Graph (IASG) and the InteR-class Structure Graph (IRSG). Specifically, the IASG effectively models the intra-class semantic correlations of each facial semantic component, thus producing realistic facial details. To preserve the generated faces being more structure-coordinated, the IRSG models inter-class structural relations among every facial component by graph representation learning. To further enhance the perceptual quality of synthesized images, we present a biphasic interactive cycle training strategy by fully taking advantage of the multi-level feature consistency between the photo and sketch. Extensive experiments demonstrate that our method outperforms the state-of-the-art competitors on the CUFS and CUFSF datasets.

Cartoon Face Synthesis Based on Markov Network

Face Cartoon Synthesis Based on the Active Appearance Model

Guided Face Cartoon Synthesis.

Structure-Preserved Face Cartoonization

Synthesis, Style Editing, and Animation of 3D Cartoon Face

Retrieval Based Cartoon Synthesis Via Heterogeneous Features Learning

Animating Cartoon Faces by Multi-View Drawings

Cartoon Synthesis Using Constrained Spreading Activation Network

Few-Shot Knowledge Transfer for Fine-Grained Cartoon Face Generation

Performance-Driven Animation of Hand-Drawn Cartoon Faces

A Face Cartoon Producer for Digital Content Service

Face sketch-to-photo synthesis from simple line drawing.

Image-based facial sketch-to-photo synthesis via online coupled dictionary learning

Image based Face Sketch-to-Photo via Online Coupled Dictionary Learning

3D Face Cartoonizer: Generating Personalized 3D Cartoon Faces from 2D Real Photos with a Hybrid Dataset

Biphasic Face Photo-Sketch Synthesis via Semantic-Driven Generative Adversarial Network with Graph Representation Learning

RefFaceNet: Reference-based Face Image Generation from Line Art Drawings

Multiple Representations-Based Face Sketch–Photo Synthesis

Audio-driven Talking Face Video Generation with Natural Head Pose

Composition-Aided Face Photo-Sketch Synthesis.

Creative cartoon face synthesis system for mobile entertainment