Abstract:Facial makeup transfer is a hot research field in computer vision, aiming to transfer the reference face's makeup style to the non-makeup face. In the existing research, we can use to combat the loss to keep the identity information of the face consistent before and after the makeup transfer, but because the input face sometimes has a massive deflection and expression action, which seriously affects the effect of makeup transfer. This paper proposed a face makeup transfer framework based on multi-scale feature loss. Our model is composed of a generator, discriminator, and multi-scale discriminator. The reference makeup and the non-makeup face are input into the generator at the same time. The generator will output the non-makeup face after makeup, which contains the input non-makeup face's identity information and the reference makeup style. To enhance the robustness of the makeup result on the network and improve the effect of makeup on the network, the output makeup face and the input non-makeup face are input into the multiscale discriminator to calculate the feature loss. The multi-scale discriminator takes the pixel multiplication of the semantic segmentation image of the makeup face and the non-makeup face as the input 1 of the multi-scale discriminator, and the pixel multiplication of the non-makeup face and its semantic segmentation as the input 2 of the multi-scale discriminator, and then calculates the feature loss of the two inputs after passing through the multi-scale discriminator. In the calculation process, the feature loss can constrain the pixel differences of different semantic segmentation, which can restrain the shadow and makeup overflow caused by angle deflection and facial expression in makeup transfer. The experimental results show that this paper's experimental method achieves a better effect of makeup transfer than the existing experimental methods.

Makeup Removal for Face Verification Based Upon Contrastive Learning

Anti-Makeup: Learning A Bi-Level Adversarial Network for Makeup-Invariant Face Verification

A Weakly Supervised Method for Makeup-Invariant Face Verification.

Cosmetic-Aware Makeup Cleanser

Makeup-robust face verification

Adversarial Learning with Collaborative Attention for Facial Makeup Removal

FM2u-Net: Face Morphological Multi-Branch Network for Makeup-Invariant Face Verification

Face Makeup Transfer Based on Generative Adversarial Network.

Makeup Transfer Based on Multi-Scale Feature Loss

MakeupDiffuse: a double image-controlled diffusion model for exquisite makeup transfer

Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfer

Makeup Transfer Based on Generative Adversarial Network for Large Angle Spatial Misalignment.

Automatic Makeup Based on Generative Adversarial Nets.

SLGAN: Style- and Latent-guided Generative Adversarial Network for Desirable Makeup Transfer and Removal

Real-World Automatic Makeup Via Identity Preservation Makeup Net

Improving Makeup Face Verification by Exploring Part-Based Representations

Multimodel Facial Makeup Translation with Generative Adversarial Networks

3D-Aware Adversarial Makeup Generation for Facial Privacy Protection

Deep Learning Models for Automatic Makeup Detection

A Fine Rendering High-Resolution Makeup Transfer network via inversion-editing strategy

Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors