Abstract:Facial makeup transfer is a hot research field in computer vision, aiming to transfer the reference face's makeup style to the non-makeup face. In the existing research, we can use to combat the loss to keep the identity information of the face consistent before and after the makeup transfer, but because the input face sometimes has a massive deflection and expression action, which seriously affects the effect of makeup transfer. This paper proposed a face makeup transfer framework based on multi-scale feature loss. Our model is composed of a generator, discriminator, and multi-scale discriminator. The reference makeup and the non-makeup face are input into the generator at the same time. The generator will output the non-makeup face after makeup, which contains the input non-makeup face's identity information and the reference makeup style. To enhance the robustness of the makeup result on the network and improve the effect of makeup on the network, the output makeup face and the input non-makeup face are input into the multiscale discriminator to calculate the feature loss. The multi-scale discriminator takes the pixel multiplication of the semantic segmentation image of the makeup face and the non-makeup face as the input 1 of the multi-scale discriminator, and the pixel multiplication of the non-makeup face and its semantic segmentation as the input 2 of the multi-scale discriminator, and then calculates the feature loss of the two inputs after passing through the multi-scale discriminator. In the calculation process, the feature loss can constrain the pixel differences of different semantic segmentation, which can restrain the shadow and makeup overflow caused by angle deflection and facial expression in makeup transfer. The experimental results show that this paper's experimental method achieves a better effect of makeup transfer than the existing experimental methods.

Multimodel Facial Makeup Translation with Generative Adversarial Networks

Multimodal-driven Talking Face Generation, Face Swapping, Diffusion Model

Face Makeup Transfer Based on Generative Adversarial Network.

Makeup Transfer Based on Generative Adversarial Network for Large Angle Spatial Misalignment.

Composite makeup transfer model based on generative adversarial networks

Automatic Makeup Based on Generative Adversarial Nets.

MakeupDiffuse: a double image-controlled diffusion model for exquisite makeup transfer

Disentangled Makeup Transfer with Generative Adversarial Network

A Multi-Granularity Facial Extreme Makeup Transfer and Removal Model with Local-Global Collaboration

DCCMF-GAN: double cycle consistently constrained multi-feature discrimination GAN for makeup transfer

RAMT-GAN: Realistic and accurate makeup transfer with generative adversarial network

Makeup Transfer Based on Multi-Scale Feature Loss

FrseGAN: Free‐style editable facial makeup transfer based on GAN combined with transformer

A robust transformer GAN for unpaired data makeup transfer

Adversarial Learning with Collaborative Attention for Facial Makeup Removal

Facial Makeup Transfer with GAN for Different Aging Faces

Local Facial Makeup Transfer via Disentangled Representation

DA-GAN: Dual-attention Generative Adversarial Networks for Real-World Exquisite Makeup Transfer

TSEV-GAN: Generative Adversarial Networks with Target-aware Style Encoding and Verification for Facial Makeup Transfer.

SLGAN: Style- and Latent-guided Generative Adversarial Network for Desirable Makeup Transfer and Removal

Spatially-invariant Style-codes Controlled Makeup Transfer