Abstract:Existing image-to-image translation methods usually adopt an encoder-decoder structure to generate images. The encoder extracts the features of input images using a sequence of convolution layers until a bottleneck, and then, the intermediate features are decoded to the target image. However, the existence of bottleneck layer in such structure may lead to blurry and bad quality of the translated images, since different domain translations may be related to the global or local region in the input image or even in an abstract level. To prevent these problems, we propose the channel attention networks for image translation in this paper. It is a novel model that supports the multi-domain image-to-image translation using one single model. Conditioning on the target domain label, an auto-encoder-like network with multiple attention connections is trained to translate the input image into the target domain The attention connections better shuttle the low-level information in the encoder to the decoder, which helps to preserve the structure. A multi-level attention mechanism is also designed in the proposed model to further improve the performance of our model. More specially, the feature maps in the encoder are first squeezed by average pooling and used to output a channel-wise attention mask. The attention mask softly determines which channels of the feature maps are translated and which channels are kept. By enforcing the model to learn a cyclic domain transformation during training, our model does not require paired training data, which greatly improves the versatility to different kinds of data. We experimentally demonstrated the effectiveness of our proposed model on the facial and clothing image translation tasks. The extensive ablations are also conducted to further validate the contribution of the proposed attention module used in our model.

HE-ASR-IT: Hybrid Excitation and Adaptive Style Recombination for Unpaired Image-to-Image Translation

Image Cross-Domain Translation Algorithm Based on Self-Similarity and Contrastive Learning

Unpaired Salient Object Translation Via Spatial Attention Prior

Multimodal Image-to-Image Translation via Mutual Information Estimation and Maximization

Single-image Translation Based on Improved Spatial Attention and Hybrid Convolution

UATST: Towards Unpaired Arbitrary Text-Guided Style Transfer with Cross-Space Modulation

Towards Diverse Image-to-image Translation Via Adaptive Normalization Layer and Contrast Learning

Show, Attend and Translate: Unsupervised Image Translation with Self-Regularization and Attention

Unsupervised Exemplar-Domain Aware Image-to-Image Translation.

Unsupervised content and style learning for multimodal cross-domain image translation

Contrastive Learning with Attention Mechanism and Multi-Scale Sample Network for Unpaired Image-to-Image Translation

Channel Attention Networks for Image Translation.

Masked and Adaptive Transformer for Exemplar Based Image Translation

Show, Attend and Translate: Unpaired Multi-Domain Image-to-Image Translation with Visual Attention

Unpaired Image-to-Image Translation Using Adversarial Consistency Loss

Unsupervised Multi-Domain Multimodal Image-to-image Translation with Explicit Domain-Constrained Disentanglement.

Harnessing the Conditioning Sensorium for Improved Image Translation

SDA-GAN: Unsupervised Image Translation Using Spectral Domain Attention-Guided Generative Adversarial Network

Multi-modal Image Synthesis Combining Content-Style Adaptive Normalization and Attentive Normalization.

CRPGAN: Learning image-to-image translation of two unpaired images by cross-attention mechanism and parallelization strategy

Unpaired Image-to-Image Translation from Shared Deep Space.