Abstract:Image-to-image translation is to transfer images from a source domain to a target domain. Conditional Generative Adversarial Networks (GANs) have enabled a variety of applications. Initial GANs typically conclude one single generator for generating a target image. Recently, using multiple generators has shown promising results in various tasks. However, generators in these works are typically of homogeneous architectures. In this paper, we argue that heterogeneous generators are complementary to each other and will benefit the generation of images. By heterogeneous, we mean that generators are of different architectures, focus on diverse positions, and perform over multiple scales. To this end, we build two generators by using a deep U-Net and a shallow residual network, respectively. The former concludes a series of down-sampling and up-sampling layers, which typically have large perception field and great spatial locality. In contrast, the residual network has small perceptual fields and works well in characterizing details, especially textures and local patterns. Afterwards, we use a gated fusion network to combine these two generators for producing a final output. The gated fusion unit automatically induces heterogeneous generators to focus on different positions and complement each other. Finally, we propose a novel approach to integrate multi-level and multi-scale features in the discriminator. This multi-layer integration discriminator encourages generators to produce realistic details from coarse to fine scales. We quantitatively and qualitatively evaluate our model on various benchmark datasets. Experimental results demonstrate that our method significantly improves the quality of transferred images, across a variety of image-to-image translation tasks. We have made our code and results publicly available: http://aiart.live/chan/.

Realistic Image-to-Image Translation with Enhanced Texture

ECycleGAN

Ecgan: Image Translation With Multi-Scale Relativistic Average Discriminator

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

FashionR2R: Texture-preserving Rendered-to-Real Image Translation with Diffusion Models

CycleGAN with Better Cycles

toon2real: Translating Cartoon Images to Realistic Images

JND-GAN: Human-Vision-Systems Inspired Generative Adversarial Networks for Image-to-Image Translation

Contour-enhanced CycleGAN framework for style transfer from scenery photos to Chinese landscape paintings

Interactive Translation in Echocardiography Training System with Enhanced Cycle-GAN

An Extensive Study of Cycle-Consistent Generative Networks for Image-to-Image Translation

TC-CycleGAN: Improved CycleGAN with Texture Constraints for Virtual Staining of Pathological Images.

Attention-Based Spatial Guidance for Image-to-Image Translation

Dual Stage Augmented Colorful Texture Synthesis from Hand Sketch

Image Translation with Dual‐directional Generative Adversarial Networks

Multi-Texture GAN: Exploring the Multi-Scale Texture Translation for Brain MR Images

Rethinking CycleGAN: Improving Quality of GANs for Unpaired Image-to-Image Translation

Conditional Generative ConvNets for Exemplar-Based Texture Synthesis

Blind Image Super Resolution with Semantic-Aware Quantized Texture Prior

Texture Synthesis with Spatial Generative Adversarial Networks

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation