Abstract:A Generative Adversarial Network (GAN) can learn the relationship between two image domains and achieve unpaired image-to-image translation. One of the breakthroughs was Cycle-consistent Generative Adversarial Networks (CycleGAN), which is a popular method to transfer the content representations from the source domain to the target domain. Existing studies have gradually improved the performance of CycleGAN models by modifying the network structure or loss function of CycleGAN. However, these methods tend to suffer from training instability and the generators lack the ability to acquire the most discriminating features between the source and target domains, thus making the generated images of low fidelity and few texture details. To overcome these issues, this paper proposes a new method that combines Evolutionary Algorithms (EAs) and Attention Mechanisms to train GANs. Specifically, from an initial CycleGAN, binary vectors indicating the activation of the weights of the generators are progressively improved upon by means of an EA. At the end of this process, the best-performing configurations of generators can be retained for image generation. In addition, to address the issues of low fidelity and lack of texture details on generated images, we make use of the channel attention mechanism. The latter component allows the candidate generators to learn important features of real images and thus generate images with higher quality. The experiments demonstrate qualitatively and quantitatively that the proposed method, namely, Attention evolutionary GAN (AevoGAN) alleviates the training instability problems of CycleGAN training. In the test results, the proposed method can generate higher quality images and obtain better results than the CycleGAN training methods present in the literature, in terms of Inception Score (IS), Fréchet Inception Distance (FID) and Kernel Inception Distance (KID).

ArCycleGAN: Improved CycleGAN for Style Transferring of Fruit Images

Creative and Diverse Artwork Generation Using Adversarial Networks

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Visual resource extraction and artistic communication model design based on improved CycleGAN algorithm

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

Correlation-based and Content-Enhanced Network for Video Style Transfer

Deep Learning-Based Application of Image Style Transfer

A Generative Adversarial Network AMS-CycleGAN for Multi-Style Image Transformation

Artistic Image Style Transfer Based on CycleGAN Network Model

Optimization of image style transfer algorithm based on CycleGAN

Gated-GAN: Adversarial Gated Networks for Multi-Collection Style Transfer

Digital Image Art Style Transfer Algorithm Based on CycleGAN

Contour-enhanced CycleGAN framework for style transfer from scenery photos to Chinese landscape paintings

Style Transformer for Image Inversion and Editing

CycleGAN with Better Cycles

A model integrating attention mechanism and generative adversarial network for image style transfer

Loss functions for Style Transfer with CycleGAN

A comparison of art style transfer in Cycle-GAN based on different generators

A Method based on Evolutionary Algorithms and Channel Attention Mechanism to Enhance Cycle Generative Adversarial Network Performance for Image Translation

Unsupervised image style transformation of generative adversarial networks based on cyclic consistency

Ecgan: Image Translation With Multi-Scale Relativistic Average Discriminator