Abstract:Face reshaping aims to adjust the shape of a face in a portrait image to make the face aesthetically beautiful, which has many potential applications. Existing methods 1) operate on the pre-defined facial landmarks, leading to artifacts and distortions due to the limited number of landmarks, 2) synthesize new faces based on segmentation masks or sketches, causing generated faces to look dissatisfied due to the losses of skin details and difficulties in dealing with hair and background blurring, and 3) project the positions of the deformed feature points from the 3D face model to the 2D image, making the results unrealistic because of the misalignment between feature points. In this paper, we propose a novel method named face shape transfer (FST) via semantic warping, which can transfer both the overall face and individual components (e.g., eyes, nose, and mouth) of a reference image to the source image. To achieve controllability at the component level, we introduce five encoding networks, which are designed to learn feature embedding specific to different face components. To effectively exploit the features obtained from semantic parsing maps at different scales, we employ a straightforward method of directly connecting all layers within the global dense network. This direct connection facilitates maximum information flow between layers, efficiently utilizing diverse scale semantic parsing information. To avoid deformation artifacts, we introduce a spatial transformer network, allowing the network to handle different types of semantic warping effectively. To facilitate extensive evaluation, we construct a large-scale high-resolution face dataset, which contains 14,000 images with a resolution of 1024 × 1024. Superior performance of our method is demonstrated by qualitative and quantitative experiments on the benchmark dataset.

CRFAST: Clip-Based Reference-Guided Facial Image Semantic Transfer

Expression Conditional Gan for Facial Expression-to-Expression Translation.

FaceSwapNet: Landmark Guided Many-to-Many Face Reenactment

FaceCLIP: Facial Image-to-Video Translation Via A Brief Text Description

FacialGAN: Style Transfer and Attribute Manipulation on Synthetic Faces

Unconstrained Facial Expression Transfer using Style-based Generator

Face Shape Transfer Via Semantic Warping

StyleIPSB: Identity-Preserving Semantic Basis of StyleGAN for High Fidelity Face Swapping

ExpCLIP: Bridging Text and Facial Expressions via Semantic Alignment

TextCLIP: Text-Guided Face Image Generation And Manipulation Without Adversarial Training

Facial Expression Transfer Based on Conditional Generative Adversarial Networks.

Sem-CS: Semantic CLIPStyler for Text-Based Image Style Transfer

Multi-scale Generative Adversarial Learning for Facial Attribute Transfer.

FrseGAN: Free‐style editable facial makeup transfer based on GAN combined with transformer

CLIPstyler: Image Style Transfer with a Single Text Condition

Spatially-invariant Style-codes Controlled Makeup Transfer

Foreground and background separated image style transfer with a single text condition

Enhancing Zero-Shot Facial Expression Recognition by LLM Knowledge Transfer

FiGCLIP: Fine-Grained CLIP Adaptation via Densely Annotated Videos