Abstract:Face editing represents a popular research topic within the computer vision and image processing communities. While significant progress has been made recently in this area, existing solutions: (i) are still largely focused on low-resolution images, (ii) often generate editing results with visual artefacts, or (iii) lack fine-grained control over the editing procedure and alter multiple (entangled) attributes simultaneously, when trying to generate the desired facial semantics. In this paper, we aim to address these issues through a novel editing approach, called MaskFaceGAN that focuses on local attribute editing. The proposed approach is based on an optimization procedure that directly optimizes the latent code of a pre-trained (state-of-the-art) Generative Adversarial Network (i.e., StyleGAN2) with respect to several constraints that ensure: (i) preservation of relevant image content, (ii) generation of the targeted facial attributes, and (iii) spatially-selective treatment of local image regions. The constraints are enforced with the help of an (differentiable) attribute classifier and face parser that provide the necessary reference information for the optimization procedure. MaskFaceGAN is evaluated in extensive experiments on the FRGC, SiblingsDB-HQf, and XM2VTS datasets and in comparison with several state-of-the-art techniques from the literature. Our experimental results show that the proposed approach is able to edit face images with respect to several local facial attributes with unprecedented image quality and at high-resolutions ( 1024×1024 ), while exhibiting considerably less problems with attribute entanglement than competing solutions. The source code is publicly available from: https://github.com/MartinPernus/MaskFaceGAN.

Mask Optimization Based on Conditional Generative Adversarial Nets

Expression Conditional Gan for Facial Expression-to-Expression Translation.

Attack Deterministic Conditional Image Generative Models for Diverse and Controllable Generation

Statistics Enhancement Generative Adversarial Networks for Diverse Conditional Image Synthesis

Mask-Guided Portrait Editing With Conditional GANs

Learning Efficient GANs using Differentiable Masks and co-Attention Distillation.

Generative adversarial network for optimization of operational parameters based on shield posture requirements

Learning Efficient GANs Using Differentiable Masks and Co-Attention Distillation

MaskFaceGAN: High-Resolution Face Editing With Masked GAN Latent Code Optimization

Assessment of Tool Wear With Insufficient and Unbalanced Data Using Improved Conditional Generative Adversarial Net and High-Quality Optimization Algorithm

DMD maskless lithography optimization based on an improved genetic algorithm

Gradient-Based Source And Mask Optimization In Optical Lithography

A self-training end-to-end mask optimization framework based on semantic segmentation network

Leveraging Conditional Generative Adversarial Networks (cGANs) for enhanced artistic creation: Exploring quality improvement and content control through conditional inputs

Mitigating the forbidden pitch of extreme ultraviolet lithography using mask optimization based on genetic algorithm

Source and Mask Co-Optimization Using A Gradient Based Method in Optical Lithography

McGAN: Generating Manufacturable Designs by Embedding Manufacturing Rules into Conditional Generative Adversarial Network

Learning Efficient GANs for Image Translation Via Differentiable Masks and Co-Attention Distillation

Mask Optimization Based On Block Non-Uniform Grid Convolution

Efficient Model-Based OPC via Graph Neural Network

Global optimisation of source and mask in inverse lithography via tabu search combined with genetic algorithm.