Abstract:Facial image editing is one of the hot topics in recent years due to the great development in deep generative models. Current models are either based on variational autoencoder(VAE) or generative adversarial network(GAN). However, VAE-based models usually generate oversmooth images, while GAN-based-only models cannot randomly generate images with specific attributes and suffer from unstable training. To overcome these limitations, a novel attribute-disentangled generative model based on the combination of VAE and GAN is proposed for facial image editing by manipulating specific attributes and synthesizing facial images conditioned on the specified attributes. In the encoder-decoder architecture of the proposed model, the latent space mapped by the encoder is split into two subspaces: the attribute-irrelevant space and the attribute-relevant space. The attribute-irrelevant space characterizes the factors such as identity, position, background etc, which are expected to be kept unchanged during the editing. The attribute-relevant space is used to represent the attributes such as hair color, gender, age etc that we want to manipulate. We use the adversarial training scheme to train the model, where images generated by the proposed model are re-feeded to the encoder to ensure their distribution is close to the real data distribution in the attribute-irrelevant subspace while they can be correctly classified in the attribute-relevant subspace, without explicitly giving the discriminators such as in GANs. To evaluate the performance of the proposed model, quantitative and qualitative comparisons between the proposed model and other state-of-the-art algorithms were tesed on the CelebA dataset. The evaluation results show that the proposed model can effectively generate high-quality facial images with diverse specified attributes.

Face Attribute Editing with Disentangled Latent Vectors

VecGAN: Image-to-Image Translation with Interpretable Latent Directions

Disentangled Face Attribute Editing via Instance-Aware Latent Space Search

A Latent Transformer for Disentangled Face Editing in Images and Videos

Interpreting the Latent Space of GANs for Semantic Face Editing

FEditNet++: Few-Shot Editing of Latent Semantics in GAN Spaces with Correlated Attribute Disentanglement

Towards Spatially Disentangled Manipulation of Face Images With Pre-Trained StyleGANs

TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing

Disentangled face editing via individual walk in personalized facial semantic field

Adaptive Nonlinear Latent Transformation for Conditional Face Editing

A novel attribute-based generation architecture for facial image editing

Facial Attribute Editing Using Generative Adversarial Network

Multi-Attribute Transfer Via Disentangled Representation.

Multi-Directional Subspace Editing in Style-Space

Neural Face Editing with Intrinsic Image Disentangling

Efficient 3D-Aware Facial Image Editing via Attribute-Specific Prompt Learning

FEAT: Face Editing with Attention

Scaling-up Disentanglement for Image Translation

Semantic Unfolding of StyleGAN Latent Space

ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulation

Deep Realistic Facial Editing via Label-restricted Mask Disentanglement