Abstract:Modifying facial attributes without the paired dataset proves to be a challenging task. Previously, approaches either required supervision from a ground-truth transformed image or required training a separate model for mapping every pair of attributes. These limit the scalability of the models to accommodate a larger set of attributes since the number of models that we need to train grows exponentially large. Another major drawback of the previous approaches is the unintentional gain of the identity of the person as they transform the facial attributes. We propose a method that allows for controllable and identity-aware transformations across multiple facial attributes using only a single model. Our approach is to train a generative adversarial network (GAN) with a multitask conditional discriminator that recognizes the identity of the face, distinguishes real images from fake, as well as identifies facial attributes present in an image. This guides the generator into producing an output that is realistic while preserving the person's identity and facial attributes. Through this framework, our model also learns meaningful image representations in a lower dimensional latent space and semantically associate separate parts of the encoded vector with both the person's identity and facial attributes. This opens up the possibility of generating new faces and other transformations such as making the face thinner or chubbier. Furthermore, our model only encodes the image once and allows for multiple transformations using the encoded vector. This allows for faster transformations since it does not need to reprocess the entire image for every transformation. We show the effectiveness of our proposed method through both qualitative and quantitative evaluations, such as ablative studies, visual inspection, and face verification. Competitive results are achieved compared to the main competition (CycleGAN), however, at great space and extensibility gain by using a single model.

Unsupervised Local Facial Attributes Transfer Using Dual Discriminative Adversarial Networks

Selective Domain-Invariant Feature Alignment Network for Face Anti-Spoofing.

When Masked Image Modeling Meets Source-free Unsupervised Domain Adaptation: Dual-Level Masked Network for Semantic Segmentation

Attribute-Guided Sketch Generation

Unsupervised Facial Image Synthesis Using Two-Discriminator Adversarial Autoencoder Network

Multi-scale Generative Adversarial Learning for Facial Attribute Transfer.

Deep Identity-aware Transfer of Facial Attributes

Multi-Attribute Transfer Via Disentangled Representation.

DA-GAN: Dual-attention Generative Adversarial Networks for Real-World Exquisite Makeup Transfer

Dual feature disentanglement for face anti-spoofing

Controllable and Identity-Aware Facial Attribute Transformation

Local Facial Makeup Transfer via Disentangled Representation

Multi-source adversarial transfer learning based on similar source domains with local features

Adv-Attribute: Inconspicuous and Transferable Adversarial Attack on Face Recognition

ResAttr-GAN: Unpaired Deep Residual Attributes Learning for Multi-Domain Face Image Translation

Facial Expression Recognition in the Wild: A Cycle-Consistent Adversarial Attention Transfer Approach.

A Dual-Direction Attention Mixed Feature Network for Facial Expression Recognition

Harnessing Synthesized Abstraction Images to Improve Facial Attribute Recognition

Facial Expression Transfer Based on Conditional Generative Adversarial Networks.

Unsupervised Domain Adaptation with Regularized Optimal Transport for Multimodal 2D+3D Facial Expression Recognition

Spatial Attention Guided Local Facial Attribute Editing