Abstract:Facial makeup transfer is a hot research field in computer vision, aiming to transfer the reference face's makeup style to the non-makeup face. In the existing research, we can use to combat the loss to keep the identity information of the face consistent before and after the makeup transfer, but because the input face sometimes has a massive deflection and expression action, which seriously affects the effect of makeup transfer. This paper proposed a face makeup transfer framework based on multi-scale feature loss. Our model is composed of a generator, discriminator, and multi-scale discriminator. The reference makeup and the non-makeup face are input into the generator at the same time. The generator will output the non-makeup face after makeup, which contains the input non-makeup face's identity information and the reference makeup style. To enhance the robustness of the makeup result on the network and improve the effect of makeup on the network, the output makeup face and the input non-makeup face are input into the multiscale discriminator to calculate the feature loss. The multi-scale discriminator takes the pixel multiplication of the semantic segmentation image of the makeup face and the non-makeup face as the input 1 of the multi-scale discriminator, and the pixel multiplication of the non-makeup face and its semantic segmentation as the input 2 of the multi-scale discriminator, and then calculates the feature loss of the two inputs after passing through the multi-scale discriminator. In the calculation process, the feature loss can constrain the pixel differences of different semantic segmentation, which can restrain the shadow and makeup overflow caused by angle deflection and facial expression in makeup transfer. The experimental results show that this paper's experimental method achieves a better effect of makeup transfer than the existing experimental methods.

Facial Makeup Transfer with GAN for Different Aging Faces

Face Makeup Transfer Based on Generative Adversarial Network.

Makeup Transfer Based on Multi-Scale Feature Loss

Makeup Transfer Based on Generative Adversarial Network for Large Angle Spatial Misalignment.

High Fidelity Makeup Via 2D and 3D Identity Preservation Net

RAMT-GAN: Realistic and accurate makeup transfer with generative adversarial network

Example Based Facial Aging Simulation Via Facial Detail Transfer.

Multimodel Facial Makeup Translation with Generative Adversarial Networks

Age Factor Removal Network Based on Transfer Learning and Adversarial Learning for Cross-Age Face Recognition.

Composite makeup transfer model based on generative adversarial networks

A Fine Rendering High-Resolution Makeup Transfer network via inversion-editing strategy

How Old Are You? Face Age Translation with Identity Preservation Using GANs

Face Aging with Contextual Generative Adversarial Nets

DCCMF-GAN: double cycle consistently constrained multi-feature discrimination GAN for makeup transfer

FrseGAN: Free‐style editable facial makeup transfer based on GAN combined with transformer

Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfer

Multi-scale feature fusion model followed by residual network for generation of face aging and de-aging

MuNeRF: Robust Makeup Transfer in Neural Radiance Fields

Age Progression and Regression with Spatial Attention Modules

A Multi-Granularity Facial Extreme Makeup Transfer and Removal Model with Local-Global Collaboration

SOGAN: 3D-Aware Shadow and Occlusion Robust GAN for Makeup Transfer