Abstract:The rise of comics and games has led to increased artistic processing of portrait photos. With growing commercial demand and advancements in deep learning, neural networks for rapid facial style transfer have become a key research area in computer vision. This involves converting face photos into different styles while preserving content. Face images are more complex than regular images, requiring extensive modification. However, current methods often face issues such as unnatural color transitions, loss of detail in highlighted areas, and noticeable artifacts along edges, resulting in low-quality stylized images. In this study, an enhanced generative adversarial network (GAN) is proposed, which is based on Adaptive Layer Instance Normalization (AdaLIN) + Laplacian. This approach incorporates the AdaLIN normalization method, allowing for the dynamic adjustment of Instance Normalization (IN) and Layer Normalization (LN) parameters’ weights during training. By combining the strengths of both normalization techniques, the model selectively preserves and alters content information to some extent, aiming to strike a balance between style and content. This helps address problems such as unnatural color transitions and loss of details in highlights that lead to color inconsistencies. Furthermore, the introduction of a Laplacian regularization term aids in denoising the image, preventing noise features from interfering with the color transfer process. This regularization also helps reduce color artifacts along the face’s edges caused by noise while maintaining the image’s contour information. These enhancements significantly enhance the quality of the generated face images. To compare our method with traditional CycleGAN and recent algorithms such as XGAN and CariGAN, both subjective and objective evaluations were conducted. Subjectively, our method demonstrates more natural color transitions and superior artifact elimination, achieving higher scores in Mean Opinion Score (MOS) evaluations. Objectively, experiments using our method yielded better scores across three metrics: FID, SSIM, and MS-SSIM. The effectiveness of the proposed methods is validated through both objective and subjective evaluations.

HE-CycleGAN: A Symmetric Network Based on High-Frequency Features and Edge Constraints Used to Convert Facial Sketches to Images

Attribute-Guided Sketch Generation

Identity-Aware CycleGAN for Face Photo-Sketch Synthesis and Recognition

High-Fidelity Face Sketch-To-Photo Synthesis Using Generative Adversarial Network

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Multi-Level Cycle-Consistent Adversarial Networks with Attention Mechanism for Face Sketch-Photo Synthesis

ENG-Face: Cross-Domain Heterogeneous Face Synthesis with Enhanced Asymmetric CycleGAN

An Improved Detail-Enhancement CycleGAN Using AdaLIN for Facial Style Transfer

HCGAN: hierarchical contrast generative adversarial network for unpaired sketch face synthesis

Generating Cartoon Images from Face Photos with Cycle-Consistent Adversarial Networks

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

HR-CycleGAN: Face highlight reduction based on improved cycle-consistent adversarial networks

Generating Photographic Faces From the Sketch Guided by Attribute Using GAN.

MHGAN: Multi-Hierarchies Generative Adversarial Network for High-Quality Face Sketch Synthesis

Ecgan: Image Translation With Multi-Scale Relativistic Average Discriminator

Integrating GAN with CNN for Face Sketch Synthesis

Edge Aware Domain Transformation for Face Sketch Synthesis

A Sketch-Transformer Network for Face Photo-Sketch Synthesis

FL-GAN: Feature Learning Generative Adversarial Network for High-Quality Face Sketch Synthesis

Face Sketch-to-photo Transformation with Multi-Scale Self-Attention GAN.

High-quality Face Image Generated with Conditional Boundary Equilibrium Generative Adversarial Networks