Abstract:The rise of comics and games has led to increased artistic processing of portrait photos. With growing commercial demand and advancements in deep learning, neural networks for rapid facial style transfer have become a key research area in computer vision. This involves converting face photos into different styles while preserving content. Face images are more complex than regular images, requiring extensive modification. However, current methods often face issues such as unnatural color transitions, loss of detail in highlighted areas, and noticeable artifacts along edges, resulting in low-quality stylized images. In this study, an enhanced generative adversarial network (GAN) is proposed, which is based on Adaptive Layer Instance Normalization (AdaLIN) + Laplacian. This approach incorporates the AdaLIN normalization method, allowing for the dynamic adjustment of Instance Normalization (IN) and Layer Normalization (LN) parameters’ weights during training. By combining the strengths of both normalization techniques, the model selectively preserves and alters content information to some extent, aiming to strike a balance between style and content. This helps address problems such as unnatural color transitions and loss of details in highlights that lead to color inconsistencies. Furthermore, the introduction of a Laplacian regularization term aids in denoising the image, preventing noise features from interfering with the color transfer process. This regularization also helps reduce color artifacts along the face’s edges caused by noise while maintaining the image’s contour information. These enhancements significantly enhance the quality of the generated face images. To compare our method with traditional CycleGAN and recent algorithms such as XGAN and CariGAN, both subjective and objective evaluations were conducted. Subjectively, our method demonstrates more natural color transitions and superior artifact elimination, achieving higher scores in Mean Opinion Score (MOS) evaluations. Objectively, experiments using our method yielded better scores across three metrics: FID, SSIM, and MS-SSIM. The effectiveness of the proposed methods is validated through both objective and subjective evaluations.

An Improved Detail-Enhancement CycleGAN Using AdaLIN for Facial Style Transfer

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Creative and Diverse Artwork Generation Using Adversarial Networks

Generating Cartoon Images from Face Photos with Cycle-Consistent Adversarial Networks

Unpaired Artistic Portrait Style Transfer Via Asymmetric Double-Stream GAN

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

PP-GAN : Style Transfer from Korean Portraits to ID Photos Using Landmark Extractor with GAN

AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generation

Styled and Characteristic Peking Opera Facial Makeup Synthesis with Co-training and Transfer Conditional StyleGAN2

Linear-ResNet GAN-based anime style transfer of face images

Contour-enhanced CycleGAN framework for style transfer from scenery photos to Chinese landscape paintings

Line Drawings for Face Portraits from Photos Using Global and Local Structure Based GANs

Face Image Illumination Processing Based on Generative Adversarial Nets

Visual resource extraction and artistic communication model design based on improved CycleGAN algorithm

FacialGAN: Style Transfer and Attribute Manipulation on Synthetic Faces

Digital Image Art Style Transfer Algorithm Based on CycleGAN

As time goes by: dynamic face aging method using CycleGAN

Style attention based global-local aware GAN for personalized facial caricature generation

Deep Learning-Based Application of Image Style Transfer

Artistic Image Style Transfer Based on CycleGAN Network Model