Abstract:Image cross-domain transformation, also known as image translation, is a technology that aims to transform the images of the source domain into the ones of the target domain. Specifically, the converted images have the style of the target domain images（contour, posture, etc.） while maintaining the structure of the source domain images（texture, color, etc.）. Image cross-domain transformation technology is widely used in the field of vision, such as photo editing and video special effects production. In recent years, this technology has developed rapidly based on deep learning, especially the generation of adversarial networks, and achieved impressive results. However, there are still problems, including the collapse of color mode and the inability to maintain the content structures in the transformed images. To solve the above problems, we propose an image cross-domain transformation algorithm based on self-similarity and contrastive learning. The algorithm uses the pre-trained deep neural network model to extract the content and style features of the images and takes the perceptual loss and the loss based on self-similarity as the image content loss function. At the same time, a loose optimal transport loss and the moment matching loss are used as the image style loss function to train the proposed neural network, and the transformed images and the target domain images are marked as positive sample pairs, and the translated images and the source domain images are marked as negative samples for contrastive learning. The proposed algorithm is verified by experiments on four data sets. The results show that the proposed method maintains the content structure of the source domain images,reduces the mode collapse of color, and makes the style of the translated images more consistent with that of the guidance images.

Simplified unsupervised image translation for semantic segmentation adaptation

Unpaired Salient Object Translation Via Spatial Attention Prior

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

Image Cross-Domain Translation Algorithm Based on Self-Similarity and Contrastive Learning

Segmentation Guided Image-to-Image Translation with Adversarial Networks

Scene Embedded Generative Adversarial Networks for Semi-Supervised SAR-to-Optical Image Translation

UGC: Unified GAN Compression for Efficient Image-to-Image Translation

Unsupervised Pixel-Wise Weighted Adversarial Domain Adaptation

Semantic Consistent Unsupervised Domain Adaptation for Cross-Modality Medical Image Segmentation

Semantic Invariant Cross-Domain Image Generation with Generative Adversarial Networks

Target-targeted Domain Adaptation for Unsupervised Semantic Segmentation

Unsupervised Domain Adaptation for Referring Semantic Segmentation

10.1109/ICIPMC62364.2024.10586680 Unsupervised Domain Adaptation for Cross-Modality Cardiac Image Segmentation Based on Contrastive Image Synthesis

Attribute Guided Unpaired Image-to-Image Translation with Semi-supervised Learning.

Unsupervised Adversarial Domain Adaptation Network for Semantic Segmentation

SIT-Net: Surgical Image Translation Network Using a Generative Adversarial Method with Visual Feature Disentanglement

Unsupervised Domain Adaption for Remote Sensing Semantic Segmentation with Self-Attention Mechanism

Semantically Adaptive Image-to-image Translation for Domain Adaptation of Semantic Segmentation

Unsupervised Domain Adaptation for Semantic Segmentation with Global and Local Consistency

GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation

Towards Diverse Image-to-image Translation Via Adaptive Normalization Layer and Contrast Learning