Abstract:The rise of comics and games has led to increased artistic processing of portrait photos. With growing commercial demand and advancements in deep learning, neural networks for rapid facial style transfer have become a key research area in computer vision. This involves converting face photos into different styles while preserving content. Face images are more complex than regular images, requiring extensive modification. However, current methods often face issues such as unnatural color transitions, loss of detail in highlighted areas, and noticeable artifacts along edges, resulting in low-quality stylized images. In this study, an enhanced generative adversarial network (GAN) is proposed, which is based on Adaptive Layer Instance Normalization (AdaLIN) + Laplacian. This approach incorporates the AdaLIN normalization method, allowing for the dynamic adjustment of Instance Normalization (IN) and Layer Normalization (LN) parameters’ weights during training. By combining the strengths of both normalization techniques, the model selectively preserves and alters content information to some extent, aiming to strike a balance between style and content. This helps address problems such as unnatural color transitions and loss of details in highlights that lead to color inconsistencies. Furthermore, the introduction of a Laplacian regularization term aids in denoising the image, preventing noise features from interfering with the color transfer process. This regularization also helps reduce color artifacts along the face’s edges caused by noise while maintaining the image’s contour information. These enhancements significantly enhance the quality of the generated face images. To compare our method with traditional CycleGAN and recent algorithms such as XGAN and CariGAN, both subjective and objective evaluations were conducted. Subjectively, our method demonstrates more natural color transitions and superior artifact elimination, achieving higher scores in Mean Opinion Score (MOS) evaluations. Objectively, experiments using our method yielded better scores across three metrics: FID, SSIM, and MS-SSIM. The effectiveness of the proposed methods is validated through both objective and subjective evaluations.

AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generation

Creative and Diverse Artwork Generation Using Adversarial Networks

Attribute-Guided Sketch Generation

Feature Weighted Cycle Generative Adversarial Network with Facial Landmark Recognition and Perceptual Color Distance for Enhanced Face Animation Generation

Linear-ResNet GAN-based anime style transfer of face images

Towards the Automatic Anime Characters Creation with Generative Adversarial Networks

AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collections

Towards the High-quality Anime Characters Generation with Generative Adversarial Networks

Realistic real-time processing of anime portraits based on generative adversarial networks

An Improved Detail-Enhancement CycleGAN Using AdaLIN for Facial Style Transfer

Animated Avatar Generation Technology Research Based on Deep Convolutional Generative Adversarial Network Integrated With Self-Attention and Spectral Normalization

MangaGAN: Unpaired Photo-to-Manga Translation Based on the Methodology of Manga Drawing

BaMSGAN: Self-Attention Generative Adversarial Network with Blur and Memory for Anime Face Generation

An Adaptive-Guidance GAN for Accurate Face Reenactment.

The Research of Anime Character Portrait Generation Based on Optimized Generative Adversarial Networks

CartoonGAN: Generative Adversarial Networks for Photo Cartoonization.

Enhanced Anime Image Generation Using USE-CMHSA-GAN

Cross-modal and Semantics-Augmented Asymmetric CycleGAN for Data-Imbalanced Anime Style Face Translation

Appearance-preserved Portrait-to-anime Translation via Proxy-guided Domain Adaptation

GC-GAN: Photo Cartoonization Using Guided Cartoon Generative Adversarial Network

User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks.