Abstract:Facial attribute editing aims to manipulate single or multiple attributes on a given face image, i.e., to generate a new face image with desired attributes while preserving other details. Recently, the generative adversarial net (GAN) and encoder–decoder architecture are usually incorporated to handle this task with promising results. Based on the encoder–decoder architecture, facial attribute editing is achieved by decoding the latent representation of a given face conditioned on the desired attributes. Some existing methods attempt to establish an attribute-independent latent representation for further attribute editing. However, such attribute-independent constraint on the latent representation is excessive because it restricts the capacity of the latent representation and may result in information loss, leading to over-smooth or distorted generation. Instead of imposing constraints on the latent representation, in this work, we propose to apply an <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">attribute classification constraint</italic> to the generated image to just guarantee the correct change of desired attributes, i.e., to change what you want. Meanwhile, the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">reconstruction learning</italic> is introduced to preserve attribute-excluding details, in other words, to only change what you want. Besides, the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">adversarial learning</italic> is employed for visually realistic editing. These three components cooperate with each other forming an effective framework for high quality facial attribute editing, referred as <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">AttGAN</italic> . Furthermore, the proposed method is extended for <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">attribute style manipulation</italic> in an unsupervised manner. Experiments on two wild datasets, CelebA and LFW, show that the proposed method outperforms the state-of-the-art on realistic attribute editing with other facial details well preserved.

Nonlinear hierarchical editing: A powerful framework for face editing

Editable Generative Adversarial Networks: Generating and Editing Faces Simultaneously

EditGAN: High-Precision Semantic Image Editing

Progressive Editing with Stacked Generative Adversarial Network for Multiple Facial Attribute Editing

Deep Curvilinear Editing: Commutative and Nonlinear Image Manipulation for Pretrained Deep Generative Model

Controllable Multi-Attribute Editing of High-Resolution Face Images

Neural Face Editing with Intrinsic Image Disentangling

FEAT: Face Editing with Attention

Adaptive Nonlinear Latent Transformation for Conditional Face Editing

Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigation

FEditNet++: Few-Shot Editing of Latent Semantics in GAN Spaces with Correlated Attribute Disentanglement

The GAN that Warped: Semantic Attribute Editing with Unpaired Data

Disentangled face editing via individual walk in personalized facial semantic field

AttGAN: Facial Attribute Editing by Only Changing What You Want

CoIE: Chain-of-Instruct Editing for Multi-Attribute Face Manipulation

Interpreting the Latent Space of GANs for Semantic Face Editing

Towards Disentangling Latent Space for Unsupervised Semantic Face Editing

Editing Out-of-domain GAN Inversion via Differential Activations

PA-GAN: Progressive Attention Generative Adversarial Network for Facial Attribute Editing

A Unified Architecture of Semantic Segmentation and Hierarchical Generative Adversarial Networks for Expression Manipulation

FED-NeRF: Achieve High 3D Consistency and Temporal Coherence for Face Video Editing on Dynamic NeRF