Abstract:Generative Adversarial Network (GAN) has been widely used for image-to-image translation-based facial attribute editing. Existing GAN networks are likely to generate samples with anomalies, which may be caused by the lack of consistency preservation and feature entanglement. For preserving image consistency, many studies resorted to the design of the network framework and loss functions, e.g. cycle-consistency loss. However, the generator with the cycle-consistency loss could not well preserve the attribute-irrelevant features, and its feature-level noises may possibly cause synthesis abnormalities. For feature disentanglement, previous works were devoted to mining the implicit semantics of feature spaces, while these semantics are not stable and intuitive enough. For consistency preservation, we propose a target consistency loss to complement the cycle-consistency loss, and enable the network to learn to preserve features of the image more directly. Meanwhile, we filter out outlier feature maps to reduce the synthesis abnormalities and propose a dynamic dropout to better preserve the attribute-irrelevant features. For feature disentanglement, we encode the image semantics more stably and intuitively and propose an entropy regularization to decouple these semantics to allow independent editing of different attributes. The proposed modules are general and can be easily integrated with available image-to-image-based GAN models like StarGAN, AttGAN, and STGAN. Extensive experiments on CelebA dataset show that the our strategy can largely reduce the artifacts and better preserve the subtle facial features, and thus significantly improve the facial editing performance of these mainstream GAN models, in terms of FID, PSNR and SSIM. Additional experiments on realistic expression editing show that our method outperforms StarGAN on RaFD, and achieves much better generalization performances than the three baselines on datasets of FFHQ, RaFD and LFW.

Measuring the Consistency and Diversity of 3D Face Generation.

High Diversity Attribute Guided Face Generation with GANs

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

3DFaceGAN: Adversarial Nets for 3D Face Representation, Generation, and Translation

Towards Realistic Generative 3D Face Models

Text-Driven Diverse Facial Texture Generation via Progressive Latent-Space Refinement

F?D: On understanding the role of deep feature spaces on face generation evaluation

3D-SSGAN: Lifting 2D Semantics for 3D-Aware Compositional Portrait Synthesis

Evaluating Text-to-Image GANs Performance: A Comparative Analysis of Evaluation Metrics

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Towards High-Fidelity Text-Guided 3D Face Generation and Manipulation Using only Images

3D GAN Inversion with Facial Symmetry Prior

Single Image, Any Face: Generalisable 3D Face Generation

Diversified realistic face image generation GAN for human subjects in multimedia content creation

Consistency Preservation and Feature Entropy Regularization for GAN based Face Editing

Controllable 3D Face Generation with Conditional Style Code Diffusion

Analyzing the Feature Extractor Networks for Face Image Synthesis

FaceScore: Benchmarking and Enhancing Face Quality in Human Generation

Generalized Visual Quality Assessment of GAN-Generated Face Images

IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis