Abstract:A Generative Adversarial Network (GAN) can learn the relationship between two image domains and achieve unpaired image-to-image translation. One of the breakthroughs was Cycle-consistent Generative Adversarial Networks (CycleGAN), which is a popular method to transfer the content representations from the source domain to the target domain. Existing studies have gradually improved the performance of CycleGAN models by modifying the network structure or loss function of CycleGAN. However, these methods tend to suffer from training instability and the generators lack the ability to acquire the most discriminating features between the source and target domains, thus making the generated images of low fidelity and few texture details. To overcome these issues, this paper proposes a new method that combines Evolutionary Algorithms (EAs) and Attention Mechanisms to train GANs. Specifically, from an initial CycleGAN, binary vectors indicating the activation of the weights of the generators are progressively improved upon by means of an EA. At the end of this process, the best-performing configurations of generators can be retained for image generation. In addition, to address the issues of low fidelity and lack of texture details on generated images, we make use of the channel attention mechanism. The latter component allows the candidate generators to learn important features of real images and thus generate images with higher quality. The experiments demonstrate qualitatively and quantitatively that the proposed method, namely, Attention evolutionary GAN (AevoGAN) alleviates the training instability problems of CycleGAN training. In the test results, the proposed method can generate higher quality images and obtain better results than the CycleGAN training methods present in the literature, in terms of Inception Score (IS), Fréchet Inception Distance (FID) and Kernel Inception Distance (KID).

Research on Image to Illustration Translation Method Based on CycleGAN

Creative and Diverse Artwork Generation Using Adversarial Networks

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

Contour-enhanced CycleGAN framework for style transfer from scenery photos to Chinese landscape paintings

Artistic Image Style Transfer Based on CycleGAN Network Model

Image Translation with Attention Mechanism Based on Generative Adversarial Networks.

An Extensive Study of Cycle-Consistent Generative Networks for Image-to-Image Translation

Visual resource extraction and artistic communication model design based on improved CycleGAN algorithm

Deep Learning-Based Application of Image Style Transfer

Optimization of image style transfer algorithm based on CycleGAN

ECycleGAN

Digital Image Art Style Transfer Algorithm Based on CycleGAN

Ecgan: Image Translation With Multi-Scale Relativistic Average Discriminator

A Generative Adversarial Network AMS-CycleGAN for Multi-Style Image Transformation

A Method based on Evolutionary Algorithms and Channel Attention Mechanism to Enhance Cycle Generative Adversarial Network Performance for Image Translation

CCST-GAN: Generative Adversarial Networks for Chinese Calligraphy Style Transfer

ArCycleGAN: Improved CycleGAN for Style Transferring of Fruit Images

Loss functions for Style Transfer with CycleGAN

Image Translation with Dual‐directional Generative Adversarial Networks

Ink Painting Style Transfer Using Asymmetric Cycle-Consistent Gan

RPD-GAN: Learning to Draw Realistic Paintings with Generative Adversarial Network