Abstract:The rise of comics and games has led to increased artistic processing of portrait photos. With growing commercial demand and advancements in deep learning, neural networks for rapid facial style transfer have become a key research area in computer vision. This involves converting face photos into different styles while preserving content. Face images are more complex than regular images, requiring extensive modification. However, current methods often face issues such as unnatural color transitions, loss of detail in highlighted areas, and noticeable artifacts along edges, resulting in low-quality stylized images. In this study, an enhanced generative adversarial network (GAN) is proposed, which is based on Adaptive Layer Instance Normalization (AdaLIN) + Laplacian. This approach incorporates the AdaLIN normalization method, allowing for the dynamic adjustment of Instance Normalization (IN) and Layer Normalization (LN) parameters’ weights during training. By combining the strengths of both normalization techniques, the model selectively preserves and alters content information to some extent, aiming to strike a balance between style and content. This helps address problems such as unnatural color transitions and loss of details in highlights that lead to color inconsistencies. Furthermore, the introduction of a Laplacian regularization term aids in denoising the image, preventing noise features from interfering with the color transfer process. This regularization also helps reduce color artifacts along the face’s edges caused by noise while maintaining the image’s contour information. These enhancements significantly enhance the quality of the generated face images. To compare our method with traditional CycleGAN and recent algorithms such as XGAN and CariGAN, both subjective and objective evaluations were conducted. Subjectively, our method demonstrates more natural color transitions and superior artifact elimination, achieving higher scores in Mean Opinion Score (MOS) evaluations. Objectively, experiments using our method yielded better scores across three metrics: FID, SSIM, and MS-SSIM. The effectiveness of the proposed methods is validated through both objective and subjective evaluations.

An Improved Face Synthesis Model for Two-Pathway Generative Adversarial Network.

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

2D facial landmark localization method for multi-view face synthesis image using a two-pathway generative adversarial network approach

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Improving Face Recognition by Integrating Decision Forest into GAN

Frontal View Synthesis Based on a Novel GAN with Global and Local Discriminators

High-Fidelity Face Sketch-To-Photo Synthesis Using Generative Adversarial Network

Face Merged Generative Adversarial Network with Tripartite Adversaries

Pairwise-GAN: Pose-based View Synthesis through Pair-Wise Training

TC-GAN

Face Image Translation Based on Generative Adversarial Networks

Face Synthesis and Recognition Using Disentangled Representation-Learning Wasserstein GAN

Identity-and-pose-guided Generative Adversarial Network for Face Rotation

An Improved Detail-Enhancement CycleGAN Using AdaLIN for Facial Style Transfer

Geometry Structure Preserving Based GAN for Multi-Pose Face Frontalization and Recognition

Progressive Text-to-Face Synthesis with Generative Adversarial Network

Realistic Face Image Generation Based on Generative Adversarial Network

FT-GAN: Face Transformation with Key Points Alignment for Pose-Invariant Face Recognition

Perceptual Face Completion Using A Local-Global Generative Adversarial Network

An Adaptive-Guidance GAN for Accurate Face Reenactment.

A Facial Expression Synthesis Method Based on Generative Adversarial Network.