Abstract:The goal of arbitrary Neural Style Transfer (NST) is to transform a content image into a different style. Based on the assumption that styles can be represented by global statistics, the majority of NST methods seek to match global statistics for style transfer. These global statistics disregard the multimodal property of the style because distinct semantic parts of a style image may comprise various styles. Multimodal style transfer addresses this issue by extracting semantic patterns of style images through image clustering, obtaining multiple different sub-style components. The matching of the sub-style components and content features in this case is crucial because neighboring content features may be given various sub-style components. In this paper, we propose a novel assignment based on optimal transport to solve this issue. The proposed assignment theoretically guarantees that the distributions between the stylized image and the style image are similar, and it also permits more than one sub-style component to be assigned to each content feature. Based on this soft assignment, a weighted style transfer method is proposed to blend different stylized results, each of which is stylized by one sub-style component. With a more precise description of the image style, the proposed method achieves promising stylized results. Extensive experiments are conducted to demonstrate the superior effectiveness of the proposed method.

Soft multimodal style transfer via optimal transport

Optimal Transport of Deep Feature for Image Style Transfer

Artistic Style Transfer with Internal-external Learning and Contrastive Learning

Evaluate and Improve the Quality of Neural Style Transfer.

Style Permutation for Diversified Arbitrary Style Transfer

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

Correlation-based and Content-Enhanced Network for Video Style Transfer

UATST: Towards Unpaired Arbitrary Text-Guided Style Transfer with Cross-Space Modulation

Incorporating Multiscale Contextual Loss for Image Style Transfer

Diversified Patch-based Style Transfer with Shifted Style Normalization

Optimal Transport-based Patch Matching for Image Style Transfer

Style Decomposition for Improved Neural Style Transfer

Image Neural Style Transfer with Preserving the Salient Regions.

Style Transfer by Relaxed Optimal Transport and Self-Similarity

Application of multi-level adaptive neural network based on optimization algorithm in image style transfer

Geometric Style Transfer

Style is a Distribution of Features

Neural Style Transfer with automatic style weight searching

Neural Style Transfer with Content Discrimination

HyperNST: Hyper-Networks for Neural Style Transfer

Learning Graph Neural Networks for Image Style Transfer