Abstract:Image cross-domain transformation, also known as image translation, is a technology that aims to transform the images of the source domain into the ones of the target domain. Specifically, the converted images have the style of the target domain images（contour, posture, etc.） while maintaining the structure of the source domain images（texture, color, etc.）. Image cross-domain transformation technology is widely used in the field of vision, such as photo editing and video special effects production. In recent years, this technology has developed rapidly based on deep learning, especially the generation of adversarial networks, and achieved impressive results. However, there are still problems, including the collapse of color mode and the inability to maintain the content structures in the transformed images. To solve the above problems, we propose an image cross-domain transformation algorithm based on self-similarity and contrastive learning. The algorithm uses the pre-trained deep neural network model to extract the content and style features of the images and takes the perceptual loss and the loss based on self-similarity as the image content loss function. At the same time, a loose optimal transport loss and the moment matching loss are used as the image style loss function to train the proposed neural network, and the transformed images and the target domain images are marked as positive sample pairs, and the translated images and the source domain images are marked as negative samples for contrastive learning. The proposed algorithm is verified by experiments on four data sets. The results show that the proposed method maintains the content structure of the source domain images,reduces the mode collapse of color, and makes the style of the translated images more consistent with that of the guidance images.

Cross-Domain Adversarial Autoencoder for Fine Grained Category Preserving Image Translation.

Cross-Domain Adversarial Auto-Encoder.

Image Cross-Domain Translation Algorithm Based on Self-Similarity and Contrastive Learning

Multiscale Attention-Based Subdomain Dynamic Adaptation for Cross-Domain Scene Classification

Deep Joint Two-Stream Wasserstein Auto-Encoder and Selective Attention Alignment for Unsupervised Domain Adaptation

Trust-aware Conditional Adversarial Domain Adaptation with Feature Norm Alignment.

An Adversarial Domain Adaptation Network for Cross-Domain Fine-Grained Recognition

Adversarial Domain Adaptation with Semantic Consistency for Cross-Domain Image Classification

Unpaired Cross Domain Image Translation with Augmented Auxiliary Domain Information

AugGAN: Cross Domain Adaptation with GAN-Based Data Augmentation

Auto-Encoding for Shared Cross Domain Feature Representation and Image-to-Image Translation

Taking a Closer Look at Domain Shift: Category-Level Adversaries for Semantics Consistent Domain Adaptation

Cross-domain Image Translation Algorithm Based on Self-cross Auto-encoder

Unsupervised Multi-Domain Image Translation with Domain-Specific Encoders/Decoders

Effective Visual Domain Adaptation via Generative Adversarial Distribution Matching

Multi-Domain Image-to-Image Translation with Cross-Granularity Contrastive Learning

Cross-domain image translation with a novel style-guided diversity loss design

Unsupervised Domain Adaptation Network with Category-Centric Prototype Aligner for Biomedical Image Segmentation

CyCADA: Cycle-Consistent Adversarial Domain Adaptation

Domain-Invariant Adversarial Learning for Unsupervised Domain Adaption.

Class Distribution Alignment for Adversarial Domain Adaptation