Abstract:Recent facial image synthesis methods have been mainly based on conditional generative models. Sketch-based conditions can effectively describe the geometry of faces, including the contours of facial components, hair structures, as well as salient edges (e.g., wrinkles) on face surfaces but lack effective control of appearance, which is influenced by color, material, lighting condition, etc. To have more control of generated results, one possible approach is to apply existing disentangling works to disentangle face images into geometry and appearance representations. However, existing disentangling methods are not optimized for human face editing, and cannot achieve fine control of facial details such as wrinkles. To address this issue, we propose DeepFaceEditing, a structured disentanglement framework specifically designed for face images to support face generation and editing with disentangled control of geometry and appearance. We adopt a local-to-global approach to incorporate the face domain knowledge: local component images are decomposed into geometry and appearance representations, which are fused consistently using a global fusion module to improve generation quality. We exploit sketches to assist in extracting a better geometry representation, which also supports intuitive geometry editing via sketching. The resulting method can either extract the geometry and appearance representations from face images, or directly extract the geometry representation from face sketches. Such representations allow users to easily edit and synthesize face images, with decoupled control of their geometry and appearance. Both qualitative and quantitative evaluations show the superior detail and appearance control abilities of our method compared to state-of-the-art methods.

An experimental facial synthesis system using graph cut and gradient domain fusion

A real-time interactive system for facial makeup of Peking Opera

GPU-Accelerated Parallel Realistic 3D Facial Expression Synthesis

Replacement of Facial Parts in Images.

IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis

A Visual Representation for Editing Face Images

FaceShop: Deep Sketch-based Face Image Editing

Analysis and Synthesis of Peking Opera Facial Make-Ups

Composition-Aided Face Photo-Sketch Synthesis.

Controllable Sketch-to-Image Translation for Robust Face Synthesis

Biphasic Face Photo-Sketch Synthesis via Semantic-Driven Generative Adversarial Network with Graph Representation Learning

SPECIFIC FACE SYNTHESIS BASED ON THE MODIFICATION OF THE GENERAL FACE MODEL

Facial-Sketch Synthesis: A New Challenge

DeepFaceEditing: Deep Face Generation and Editing with Disentangled Geometry and Appearance Control

ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulation

Facial Landmarks and Expression Label Guided Photorealistic Facial Expression Synthesis

FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing

Human-Inspired Facial Sketch Synthesis with Dynamic Adaptation

Face beautification: Beyond makeup transfer

Exemplar-based Generative Facial Editing

FaceStudio: Put Your Face Everywhere in Seconds