Abstract:Most of the existing image style transfer algorithms transfer the whole image style as a whole. Style feature is a set of correlation matrix based on style image, namely Gram matrix. Each matrix is a global description of the style image. This kind of methods can perform well in the insensitive semantic scenes (such as the style transfer between landscape photos), but in the sensitive semantic scenes (such as the style transfer between portrait photos), the problem of semantic mismatch will be highlighted, such as transferring the background texture of the style image to the foreground of the target image. Although the existing research takes the manually annotated semantic image as an input of the algorithm, and then guides the style transfer based on the semantic information, and finally achieves good results in the style transfer between portraits. But there are still two problems: first, semantic images need to be manually annotated, which costs human resources. In practical applications, large-scale image style transfer is often needed. Second, the details of the synthesized image are fuzzy, and the definition is not enough. We propose an image style transfer algorithm based on semantic segmentation to resolve semantic mismatching in image style transfer. Our algorithm extracts the semantic information of style image and content image automatically through a semantic segmentation network and uses the semantic information to guide the style transfer. Our algorithm builds a semantic segmentation network based on mask R-CNN, introduces semantic information, and then makes style transfer on the patch level, realizes the style transfer between similar objects (consistent semantic information). Experiments on Celeba and Wikiart show that our method could automatically extract the semantic information of style image and content image. Compared with the state-of-art approaches in this field, our method can effectively avoid semantic mismatch in the process of image st-le transfer. That is, it can maintain semantic consistency in the process of style transfer.

TsrNet: A two-stage unsupervised approach for clothing region-specific textures style transfer

TeSTNeRF: Text-Driven 3D Style Transfer Via Cross-Modal Learning.

CTH-Net: CNN-Transformer Hybrid Network for Garment Image Generation from Sketches and Color Points

Image Reference-guided Fashion Design with Structure-aware Transfer by Diffusion Models.

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

UATST: Towards Unpaired Arbitrary Text-Guided Style Transfer with Cross-Space Modulation

Shape-preserving Swapping Autoencoder for Garment Texture Transfer

Fashion style transfer: enhancing efficiency and aesthetic with a novel two-stage neural network

Image Localized Style Transfer to Design Clothes Based on CNN and Interactive Segmentation

Fashioning with Networks: Neural Style Transfer to Design Clothes

CSSNet: image-based clothing style switch

Style Transfer: From Stitching to Neural Networks

Would Your Clothes Look Good on Me? Towards Transferring Clothing Styles with Adaptive Instance Normalization

Towards Intelligent Design: A Self-Driven Framework for Collocated Clothing Synthesis Leveraging Fashion Styles and Textures

Content-Style Decoupling for Unsupervised Makeup Transfer without Generating Pseudo Ground Truth

Spatial-Aware Texture Transformer for High-Fidelity Garment Transfer.

Image Style Transfer Algorithm Based on Semantic Segmentation

SwapGAN: A Multistage Generative Approach for Person-to-Person Fashion Style Transfer

Regional Style Transfer Based on Partial Convolution Generative Adversarial Network

Learning Graph Neural Networks for Image Style Transfer