Abstract:Image-to-image translation is to transfer images from a source domain to a target domain. Conditional Generative Adversarial Networks (GANs) have enabled a variety of applications. Initial GANs typically conclude one single generator for generating a target image. Recently, using multiple generators has shown promising results in various tasks. However, generators in these works are typically of homogeneous architectures. In this paper, we argue that heterogeneous generators are complementary to each other and will benefit the generation of images. By heterogeneous, we mean that generators are of different architectures, focus on diverse positions, and perform over multiple scales. To this end, we build two generators by using a deep U-Net and a shallow residual network, respectively. The former concludes a series of down-sampling and up-sampling layers, which typically have large perception field and great spatial locality. In contrast, the residual network has small perceptual fields and works well in characterizing details, especially textures and local patterns. Afterwards, we use a gated fusion network to combine these two generators for producing a final output. The gated fusion unit automatically induces heterogeneous generators to focus on different positions and complement each other. Finally, we propose a novel approach to integrate multi-level and multi-scale features in the discriminator. This multi-layer integration discriminator encourages generators to produce realistic details from coarse to fine scales. We quantitatively and qualitatively evaluate our model on various benchmark datasets. Experimental results demonstrate that our method significantly improves the quality of transferred images, across a variety of image-to-image translation tasks. We have made our code and results publicly available: http://aiart.live/chan/.

Multi-Modality Image Inpainting using Generative Adversarial Networks

UCTGAN: Diverse Image Inpainting Based on Unsupervised Cross-Space Translation

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

Face Image Inpainting Based on Generative Adversarial Network

A Method for Face Image Inpainting Based on Autoencoder and Generative Adversarial Network.

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

Modular Generative Adversarial Networks

Multi-Scale Generative Adversarial Networks Image Inpainting Algorithm*

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

Generative Adversarial Network Using Multi-modal Guidance for Ultrasound Images Inpainting.

Multi-scale Generative Adversarial Inpainting Network Based on Cross-Layer Attention Transfer Mechanism.

Multi-scale Generative Adversarial Network with Multi-Head External Attention for Image Inpainting

A Context-Based Multi-Scale Discriminant Model for Natural Image Inpainting

Efficient texture-aware multi-GAN for image inpainting

MMGInpainting: Multi-Modality Guided Image Inpainting Based On Diffusion Models

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation

Adaptive Visual Field Multi-scale Generative Adversarial Networks Image Inpainting Base on Coordinate-Attention

SingleGAN: Image-to-Image Translation by a Single-Generator Network Using Multiple Generative Adversarial Learning.

Multi-scale Generative Model for Image Completion

Sketch-to-Face Image Translation and enhancement using a Multi-GAN approach

Domain Embedded Multi-model Generative Adversarial Networks for Image-based Face Inpainting