Abstract:Generative Adversarial Network (GAN) has been widely used for image-to-image translation-based facial attribute editing. Existing GAN networks are likely to generate samples with anomalies, which may be caused by the lack of consistency preservation and feature entanglement. For preserving image consistency, many studies resorted to the design of the network framework and loss functions, e.g. cycle-consistency loss. However, the generator with the cycle-consistency loss could not well preserve the attribute-irrelevant features, and its feature-level noises may possibly cause synthesis abnormalities. For feature disentanglement, previous works were devoted to mining the implicit semantics of feature spaces, while these semantics are not stable and intuitive enough. For consistency preservation, we propose a target consistency loss to complement the cycle-consistency loss, and enable the network to learn to preserve features of the image more directly. Meanwhile, we filter out outlier feature maps to reduce the synthesis abnormalities and propose a dynamic dropout to better preserve the attribute-irrelevant features. For feature disentanglement, we encode the image semantics more stably and intuitively and propose an entropy regularization to decouple these semantics to allow independent editing of different attributes. The proposed modules are general and can be easily integrated with available image-to-image-based GAN models like StarGAN, AttGAN, and STGAN. Extensive experiments on CelebA dataset show that the our strategy can largely reduce the artifacts and better preserve the subtle facial features, and thus significantly improve the facial editing performance of these mainstream GAN models, in terms of FID, PSNR and SSIM. Additional experiments on realistic expression editing show that our method outperforms StarGAN on RaFD, and achieves much better generalization performances than the three baselines on datasets of FFHQ, RaFD and LFW.

Disentangled face editing via individual walk in personalized facial semantic field

Realistic Face Reenactment Via Self-Supervised Disentangling of Identity and Pose

Identity-preserving Editing of Multiple Facial Attributes by Learning Global Edit Directions and Local Adjustments

Towards Disentangling Latent Space for Unsupervised Semantic Face Editing

FEAT: Face Editing with Attention

Interpreting the Latent Space of GANs for Semantic Face Editing

Controllable Face Image Editing in a Disentanglement Way

DisControlFace: Disentangled Control for Personalized Facial Image Editing

IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis

Deep Realistic Facial Editing via Label-restricted Mask Disentanglement

Neural Face Editing with Intrinsic Image Disentangling

A Latent Transformer for Disentangled Face Editing in Images and Videos

DisControlFace: Adding Disentangled Control to Diffusion Autoencoder for One-shot Explicit Facial Image Editing

Disentangled Face Attribute Editing via Instance-Aware Latent Space Search

InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs

DeepFaceEditing: Deep Face Generation and Editing with Disentangled Geometry and Appearance Control

Identity-Aware and Shape-Aware Propagation of Face Editing in Videos

Consistency Preservation and Feature Entropy Regularization for GAN based Face Editing

GuidedStyle: Attribute knowledge guided style manipulation for semantic face editing

FEditNet++: Few-Shot Editing of Latent Semantics in GAN Spaces with Correlated Attribute Disentanglement