Abstract:Unsupervised image-to-image translation refers to translating images from the source domain to the target domain, assuring that the translated images have the style of the target domain while retaining the content of the source domain. Although existing image-to-image translation methods can map an image from the source domain to the target domain, the translation results are prone to visual artifacts, and the texture and shape of the input image cannot match the target domain well. The reason for this phenomenon is that the generator ignores the most differential information between the source and target domains, preventing the extraction of the rich image feature information. In this paper, we propose a multiscale attention-generative adversarial network (MSA-GAN) for unsupervised image-to-image translation. In MSA-GAN, we design a multiscale attention network (MSANet) as the backbone of the generator, which consists of the Res2Net block and convolutional block attention module (CBAM). MSANet can extract global and local features and effectively alleviate the detail missing and blurry problems in image translation. It also focuses on the important image features and improves the ability of the network to extract features from the most distinguishing regions between the source and target domains, which allows it to better translate the texture details and object shape. In addition, to generate high-quality images, we introduce the perceptual loss to constrain high-level feature information. Extensive experimental results show that the proposed MSA-GAN achieves competitive performance in image-to-image translation. Our model outperforms several advanced models on several public benchmark datasets.

Unsupervised Image Translation Using Multi-Scale Residual GAN

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

Unsupervised image-to-image translation with multiscale attention generative adversarial network

Unsupervised Transformation Network Based on GANs for Target-Domain Oriented Multi-domain Image Translation

SingleGAN: Image-to-Image Translation by a Single-Generator Network Using Multiple Generative Adversarial Learning.

Less is More: Unified Model for Unsupervised Multi-Domain Image-to-Image Translation.

GANs with Multiple Constraints for Image Translation

Unsupervised Image-to-Image Translation with Generative Prior

Unsupervised Transformation Network Based on GANs for Target-Domain Oriented Image Translation.

OSAGGAN: one-shot unsupervised image-to-image translation using attention-guided generative adversarial networks

Multimodal Unsupervised Image-to-Image Translation Without Independent Style Encoder

Image Translation with Dual‐directional Generative Adversarial Networks

On Unsupervised Image-to-image translation and GAN stability

Dual Generator Generative Adversarial Networks for Multi-Domain Image-to-Image Translation

Image-to-image Translation Using an Offset-Based Multi-Scale Codes GAN Encoder

SoloGAN: Multi-domain Multimodal Unpaired Image-to-Image Translation Via a Single Generative Adversarial Network

UGC: Unified GAN Compression for Efficient Image-to-Image Translation

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

Learning to Transfer: Unsupervised Domain Translation Via Meta-Learning

Unsupervised Multimodal Image-to-Image Translation: Generate What You Want.

CerfGAN: A Compact, Effective, Robust, and Fast Model for Unsupervised Multi-Domain Image-to-Image Translation.