Abstract:Image cross-domain transformation, also known as image translation, is a technology that aims to transform the images of the source domain into the ones of the target domain. Specifically, the converted images have the style of the target domain images（contour, posture, etc.） while maintaining the structure of the source domain images（texture, color, etc.）. Image cross-domain transformation technology is widely used in the field of vision, such as photo editing and video special effects production. In recent years, this technology has developed rapidly based on deep learning, especially the generation of adversarial networks, and achieved impressive results. However, there are still problems, including the collapse of color mode and the inability to maintain the content structures in the transformed images. To solve the above problems, we propose an image cross-domain transformation algorithm based on self-similarity and contrastive learning. The algorithm uses the pre-trained deep neural network model to extract the content and style features of the images and takes the perceptual loss and the loss based on self-similarity as the image content loss function. At the same time, a loose optimal transport loss and the moment matching loss are used as the image style loss function to train the proposed neural network, and the transformed images and the target domain images are marked as positive sample pairs, and the translated images and the source domain images are marked as negative samples for contrastive learning. The proposed algorithm is verified by experiments on four data sets. The results show that the proposed method maintains the content structure of the source domain images,reduces the mode collapse of color, and makes the style of the translated images more consistent with that of the guidance images.

An Informative Logistic Regression for Cross-Domain Image Classification

Knowledge-based Document Embedding for Cross-Domain Text Classification

Image Cross-Domain Translation Algorithm Based on Self-Similarity and Contrastive Learning

Deep Sparse Informative Transfer SoftMax for Cross-Domain Image Classification.

Domain Invariant and Class Discriminative Feature Learning for Visual Domain Adaptation

Cross-Domain Hyperspectral Image Classification Based on Graph Convolutional Networks

Cross-denoising Network against Corrupted Labels in Medical Image Segmentation with Domain Shift

Improving the Generalization Ability of Deep Neural Networks for Cross-Domain Visual Recognition

Cross-View Regularization for Domain Adaptive Panoptic Segmentation

Experiments in cross-domain few-shot learning for image classification

Joint Category Compactness and Disturbance Reduction for Cross-Domain Classification

Single-Label Multi-Class Image Classification by Deep Logistic Regression

Cross-Domain Sentiment Classification with In-Domain Contrastive Learning

Cross-View Representation Learning: A Superior ContextIB Method for Logo Classification

Domain Generalization for Medical Imaging Classification with Linear-Dependency Regularization

Constrained Maximum Cross-Domain Likelihood for Domain Generalization

Adversarial Domain Adaptation with Semantic Consistency for Cross-Domain Image Classification

Cross-label Suppression: A Discriminative and Fast Dictionary Learning with Group Regularization.

Cross-Domain Sentiment Classification with Target Domain Specific Information

Long-Term Invariant Local Features via Implicit Cross-Domain Correspondences

Cross-Modality Bridging and Knowledge Transferring for Image Understanding