Abstract:The state-of-the-art approaches in Generative Adversarial Networks (GANs) are able to learn a mapping function from one image domain to another with unpaired image data. However, these methods often produce artifacts and can only be able to convert low-level information, but fail to transfer high-level semantic part of images. The reason is mainly that generators do not have the ability to detect the most discriminative semantic part of images, which thus makes the generated images with low-quality. To handle the limitation, in this paper we propose a novel Attention-Guided Generative Adversarial Network (AGGAN), which can detect the most discriminative semantic object and minimize changes of unwanted part for semantic manipulation problems without using extra data and models. The attention-guided generators in AGGAN are able to produce attention masks via a built-in attention mechanism, and then fuse the input image with the attention mask to obtain a target image with high-quality. Moreover, we propose a novel attention-guided discriminator which only considers attended regions. The proposed AGGAN is trained by an end-to-end fashion with an adversarial loss, cycle-consistency loss, pixel loss and attention loss. Both qualitative and quantitative results demonstrate that our approach is effective to generate sharper and more accurate images than existing models. The code is available at <a class="link-external link-https" href="https://github.com/Ha0Tang/AttentionGAN" rel="external noopener nofollow">this https URL</a>.

Research on Generative Adversarial Networks Using Twins Attention Mechanism

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Vsa-Cgan: An Intelligent Generation Model For Deep Learning Sample Database Construction

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Vanishing Twin GAN: How training a weak Generative Adversarial Network can improve semi-supervised image classification

DTGAN: Dual Attention Generative Adversarial Networks for Text-to-Image Generation

Face image generation and feature visualization using deep convolutional generative adversarial networks

Twin-GAN for Neural Machine Translation

Regional attention generative adversarial network

Data Augmentation Based on Generative Adversarial Network with Mixed Attention Mechanism

Generative adversarial networks

Image Generation and Recognition Technology Based on Attention Residual GAN

CAGAN: Text-To-Image Generation with Combined Attention GANs

Latent Dirichlet Allocation Based Generative Adversarial Networks.

Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation

Generate Desired Images from Trained Generative Adversarial Networks.

GIU-GANs: Global Information Utilization for Generative Adversarial Networks

Student's T-Generative Adversarial Networks

A Text-to-Image Generation Method Based on Multiattention Depth Residual Generation Adversarial Network

Multi-Attention Generative Adversarial Network for Image Captioning.

Attention-Bridged Modal Interaction for Text-to-Image Generation