Abstract:Generative Adversarial Networks (GANs) have recently achieved significant improvement on paired/unpaired image-to-image translation, such as photo$\rightarrow$ sketch and artist painting style transfer. However, existing models can only be capable of transferring the low-level information (e.g. color or texture changes), but fail to edit high-level semantic meanings (e.g., geometric structure or content) of objects. On the other hand, while some researches can synthesize compelling real-world images given a class label or caption, they cannot condition on arbitrary shapes or structures, which largely limits their application scenarios and interpretive capability of model results. In this work, we focus on a more challenging semantic manipulation task, which aims to modify the semantic meaning of an object while preserving its own characteristics (e.g. viewpoints and shapes), such as cow$\rightarrow$sheep, motor$\rightarrow$ bicycle, cat$\rightarrow$dog. To tackle such large semantic changes, we introduce a contrasting GAN (contrast-GAN) with a novel adversarial contrasting objective. Instead of directly making the synthesized samples close to target data as previous GANs did, our adversarial contrasting objective optimizes over the distance comparisons between samples, that is, enforcing the manipulated data be semantically closer to the real data with target category than the input data. Equipped with the new contrasting objective, a novel mask-conditional contrast-GAN architecture is proposed to enable disentangle image background with object semantic changes. Experiments on several semantic manipulation tasks on ImageNet and MSCOCO dataset show considerable performance gain by our contrast-GAN over other conditional GANs. Quantitative results further demonstrate the superiority of our model on generating manipulated results with high visual fidelity and reasonable object semantics.

DiGAN: Directional Generative Adversarial Network for Object Transfiguration

Segmentation mask and feature similarity loss guided GAN for object-oriented image-to-image translation

CDGAN: Cyclic Discriminative Generative Adversarial Networks for Image-to-Image Transformation

CSGAN: Cyclic-Synthesized Generative Adversarial Networks for image-to-image transformation

Rethinking CycleGAN: Improving Quality of GANs for Unpaired Image-to-Image Translation

Unpaired Image-to-Image Translation with Diffusion Adversarial Network

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Ecgan: Image Translation With Multi-Scale Relativistic Average Discriminator

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Biphasic Learning of GANs for High-Resolution Image-to-Image Translation

Dual Generator Generative Adversarial Networks for Multi-Domain Image-to-Image Translation

Modular Generative Adversarial Networks

TCGAN: Three-Channel Generate Adversarial Network

Segmentation Guided Image-to-Image Translation with Adversarial Networks

Generative Adversarial Network with Multi-Branch Discriminator for Cross-Species Image-to-Image Translation

Reusing Discriminators for Encoding: Towards Unsupervised Image-to-Image Translation

Generative Semantic Manipulation with Contrasting GAN

Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation

CDE-GAN: Cooperative Dual Evolution Based Generative Adversarial Network

UVCGAN v2: An Improved Cycle-Consistent GAN for Unpaired Image-to-Image Translation

PI-Trans: Parallel-Convmlp and Implicit-Transformation Based Gan for Cross-View Image Translation