Abstract:Facial makeup transfer is a hot research field in computer vision, aiming to transfer the reference face's makeup style to the non-makeup face. In the existing research, we can use to combat the loss to keep the identity information of the face consistent before and after the makeup transfer, but because the input face sometimes has a massive deflection and expression action, which seriously affects the effect of makeup transfer. This paper proposed a face makeup transfer framework based on multi-scale feature loss. Our model is composed of a generator, discriminator, and multi-scale discriminator. The reference makeup and the non-makeup face are input into the generator at the same time. The generator will output the non-makeup face after makeup, which contains the input non-makeup face's identity information and the reference makeup style. To enhance the robustness of the makeup result on the network and improve the effect of makeup on the network, the output makeup face and the input non-makeup face are input into the multiscale discriminator to calculate the feature loss. The multi-scale discriminator takes the pixel multiplication of the semantic segmentation image of the makeup face and the non-makeup face as the input 1 of the multi-scale discriminator, and the pixel multiplication of the non-makeup face and its semantic segmentation as the input 2 of the multi-scale discriminator, and then calculates the feature loss of the two inputs after passing through the multi-scale discriminator. In the calculation process, the feature loss can constrain the pixel differences of different semantic segmentation, which can restrain the shadow and makeup overflow caused by angle deflection and facial expression in makeup transfer. The experimental results show that this paper's experimental method achieves a better effect of makeup transfer than the existing experimental methods.

Local Facial Makeup Transfer via Disentangled Representation

A Multi-Granularity Facial Extreme Makeup Transfer and Removal Model with Local-Global Collaboration

Disentangled Makeup Transfer with Generative Adversarial Network

MakeupBag: Disentangling Makeup Extraction and Application

Makeup like a superstar: Deep Localized Makeup Transfer Network

BeautyREC: Robust, Efficient, and Content-preserving Makeup Transfer

Makeup Based on Segmentation and Local Transfer.

Makeup Transfer Based on Multi-Scale Feature Loss

Makeup Transfer Based on Generative Adversarial Network for Large Angle Spatial Misalignment.

Hybrid Transformers with Attention-guided Spatial Embeddings for Makeup Transfer and Removal

BeautyREC: Robust, Efficient, and Component-Specific Makeup Transfer

Personalized facial makeup transfer based on outline correspondence

A Fine Rendering High-Resolution Makeup Transfer network via inversion-editing strategy

Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Model

Spatially-invariant Style-codes Controlled Makeup Transfer

MakeupDiffuse: a double image-controlled diffusion model for exquisite makeup transfer

Multimodel Facial Makeup Translation with Generative Adversarial Networks

Face Makeup Transfer Based on Generative Adversarial Network.

Content-Style Decoupling for Unsupervised Makeup Transfer without Generating Pseudo Ground Truth

Semi-parametric Makeup Transfer Via Semantic-aware Correspondence

Composite makeup transfer model based on generative adversarial networks