Abstract:Image-to-image translation is to transfer images from a source domain to a target domain. Conditional Generative Adversarial Networks (GANs) have enabled a variety of applications. Initial GANs typically conclude one single generator for generating a target image. Recently, using multiple generators has shown promising results in various tasks. However, generators in these works are typically of homogeneous architectures. In this paper, we argue that heterogeneous generators are complementary to each other and will benefit the generation of images. By heterogeneous, we mean that generators are of different architectures, focus on diverse positions, and perform over multiple scales. To this end, we build two generators by using a deep U-Net and a shallow residual network, respectively. The former concludes a series of down-sampling and up-sampling layers, which typically have large perception field and great spatial locality. In contrast, the residual network has small perceptual fields and works well in characterizing details, especially textures and local patterns. Afterwards, we use a gated fusion network to combine these two generators for producing a final output. The gated fusion unit automatically induces heterogeneous generators to focus on different positions and complement each other. Finally, we propose a novel approach to integrate multi-level and multi-scale features in the discriminator. This multi-layer integration discriminator encourages generators to produce realistic details from coarse to fine scales. We quantitatively and qualitatively evaluate our model on various benchmark datasets. Experimental results demonstrate that our method significantly improves the quality of transferred images, across a variety of image-to-image translation tasks. We have made our code and results publicly available: http://aiart.live/chan/.

Content and Colour Distillation for Learning Image Translations with the Spatial Profile Loss

Unpaired Salient Object Translation Via Spatial Attention Prior

Image Cross-Domain Translation Algorithm Based on Self-Similarity and Contrastive Learning

Incorporating Multiscale Contextual Loss for Image Style Transfer

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

Artistic Style Transfer with Internal-external Learning and Contrastive Learning

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

SPDGAN: A Generative Adversarial Network based on SPD Manifold Learning for Automatic Image Colorization

Palette: Image-to-Image Diffusion Models

SDP-GAN: Saliency Detail Preservation Generative Adversarial Networks for High Perceptual Quality Style Transfer

Diffusion-based Image Translation using Disentangled Style and Content Representation

Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillation

GEN: Generative Equivariant Networks for Diverse Image-to-Image Translation.

Cross-domain image translation with a novel style-guided diversity loss design

Seed-to-Seed: Image Translation in Diffusion Seed Space

Segmentation mask and feature similarity loss guided GAN for object-oriented image-to-image translation

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation

Unpaired Translation from Semantic Label Maps to Images by Leveraging Domain-Specific Simulations

Thermal Infrared Colorization Via Conditional Generative Adversarial Network

TCGAN: Three-Channel Generate Adversarial Network

Learning to Generate Images with Perceptual Similarity Metrics