Abstract:Facial attribute editing aims to manipulate single or multiple attributes on a given face image, i.e., to generate a new face image with desired attributes while preserving other details. Recently, the generative adversarial net (GAN) and encoder–decoder architecture are usually incorporated to handle this task with promising results. Based on the encoder–decoder architecture, facial attribute editing is achieved by decoding the latent representation of a given face conditioned on the desired attributes. Some existing methods attempt to establish an attribute-independent latent representation for further attribute editing. However, such attribute-independent constraint on the latent representation is excessive because it restricts the capacity of the latent representation and may result in information loss, leading to over-smooth or distorted generation. Instead of imposing constraints on the latent representation, in this work, we propose to apply an <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">attribute classification constraint</italic> to the generated image to just guarantee the correct change of desired attributes, i.e., to change what you want. Meanwhile, the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">reconstruction learning</italic> is introduced to preserve attribute-excluding details, in other words, to only change what you want. Besides, the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">adversarial learning</italic> is employed for visually realistic editing. These three components cooperate with each other forming an effective framework for high quality facial attribute editing, referred as <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">AttGAN</italic> . Furthermore, the proposed method is extended for <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">attribute style manipulation</italic> in an unsupervised manner. Experiments on two wild datasets, CelebA and LFW, show that the proposed method outperforms the state-of-the-art on realistic attribute editing with other facial details well preserved.

Attributes Guided Facial Image Completion

When Face Completion Meets Irregular Holes: An Attributes Guided Deep Inpainting Network

Attribute-Guided Sketch Generation

Face Image Completion Based on GAN Prior

Efficient Generative Face Completion with Perceptual Deblurring

Face Image Inpainting Using Attribute Guided

Attentive Semantic and Perceptual Faces Completion Using Self-attention Generative Adversarial Networks

IPFC: an Attentive Face Completion Network with Identity Preserving

Photorealistic Face Completion with Semantic Parsing and Face Identity-Preserving Features.

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

MulGAN: Facial Attribute Editing by Exemplar

Perceptual Face Completion Using A Local-Global Generative Adversarial Network

Image completion using structure and texture GAN network.

Reference Guided Image Inpainting using Facial Attributes

FaceCom: Towards High-fidelity 3D Facial Shape Completion via Optimization and Inpainting Guidance

3DFP-FCGAN: Face Completion Generative Adversarial Network with 3D Facial Prior

Face Completion with Semantic Knowledge and Collaborative Adversarial Learning

FacialGAN: Style Transfer and Attribute Manipulation on Synthetic Faces

AttGAN: Facial Attribute Editing by Only Changing What You Want

Transformer-based High-Fidelity Facial Displacement Completion for Detailed 3D Face Reconstruction

Deep Portrait Image Completion and Extrapolation