Abstract:Facial attribute editing aims to manipulate single or multiple attributes on a given face image, i.e., to generate a new face image with desired attributes while preserving other details. Recently, the generative adversarial net (GAN) and encoder–decoder architecture are usually incorporated to handle this task with promising results. Based on the encoder–decoder architecture, facial attribute editing is achieved by decoding the latent representation of a given face conditioned on the desired attributes. Some existing methods attempt to establish an attribute-independent latent representation for further attribute editing. However, such attribute-independent constraint on the latent representation is excessive because it restricts the capacity of the latent representation and may result in information loss, leading to over-smooth or distorted generation. Instead of imposing constraints on the latent representation, in this work, we propose to apply an <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">attribute classification constraint</italic> to the generated image to just guarantee the correct change of desired attributes, i.e., to change what you want. Meanwhile, the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">reconstruction learning</italic> is introduced to preserve attribute-excluding details, in other words, to only change what you want. Besides, the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">adversarial learning</italic> is employed for visually realistic editing. These three components cooperate with each other forming an effective framework for high quality facial attribute editing, referred as <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">AttGAN</italic> . Furthermore, the proposed method is extended for <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">attribute style manipulation</italic> in an unsupervised manner. Experiments on two wild datasets, CelebA and LFW, show that the proposed method outperforms the state-of-the-art on realistic attribute editing with other facial details well preserved.

Unsupervised Facial Image Synthesis Using Two-Discriminator Adversarial Autoencoder Network

Attribute-Guided Sketch Generation

Photorealistic Facial Expression Synthesis by the Conditional Difference Adversarial Autoencoder

Unsupervised Local Facial Attributes Transfer Using Dual Discriminative Adversarial Networks

Face Synthesis from Visual Attributes via Sketch using Conditional VAEs and GANs

Attribute-controlled Face Photo Synthesis from Simple Line Drawing.

Transformer-Based adversarial network for semi-supervised face sketch synthesis

Facial Synthesis from Visual Attributes via Sketch using Multi-Scale Generators

Face Attribute Editing Based on Generative Adversarial Networks

Multimodal Face Synthesis From Visual Attributes

Generating Face Images with Attributes for Free.

Facial Expression Transfer Based on Conditional Generative Adversarial Networks.

Conditional Adversarial Synthesis of 3D Facial Action Units.

Joint Sketch-Attribute Learning for Fine-Grained Face Synthesis.

Facial Landmarks and Expression Label Guided Photorealistic Facial Expression Synthesis

Explicit Facial Expression Transfer via Fine-Grained Representations

AttGAN: Facial Attribute Editing by Only Changing What You Want

Geometry Guided Adversarial Facial Expression Synthesis

Face Sketch Synthesis via Semantic-Driven Generative Adversarial Network

DualG-GAN, a Dual-channel Generator based Generative Adversarial Network for text-to-face synthesis

Dual Semi-Supervised Learning for Facial Action Unit Recognition.