Abstract:Neural learning methods have been shown to be effective in style transfer. These methods, which are called NST, aim to synthesize a new image that retains the high-level structure of a content image while keeps the low-level features of a style image. However, these models using convolutional structures only extract local statistical features of style images and semantic features of content images. Since the absence of low-level features in the content image, these methods would synthesize images that look unnatural and full of traces of machines. In this paper, we find that direction, that is, the orientation of each painting stroke, can capture the soul of image style preferably and thus generates much more natural and vivid stylizations. According to this observation, we propose a direction-aware neural style transfer with texture enhancement. There are four major innovations. First, we separate the style transfer method into two stage, namely, NST stage and texture enhancement stage. Second, for the NST stage, a novel direction field loss is proposed to steer the direction of strokes in the synthesized image. And to build this loss function, we propose novel direction field loss networks to generate and compare the direction fields of content image and synthesized image. By incorporating the direction field loss in neural style transfer, we obtain a new optimization objective. Through minimizing this objective, we can produce synthesized images that better follow the direction field of the content image. Third, our method provides a simple interaction mechanism to control the generated direction fields, and further control the texture direction in synthesized images. Fourth, with a texture enhancement module, our method can add vivid texture details to the synthesized image. Experiments show that our method outperforms state-of-the-art style transfer method.

Interactive Image Style Transfer Guided by Graffiti

Evaluate and Improve the Quality of Neural Style Transfer.

Artistic Style Transfer with Internal-external Learning and Contrastive Learning

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

Diverse Image Style Transfer Via Invertible Cross-Space Mapping

ArtBank: Artistic Style Transfer with Pre-trained Diffusion Model and Implicit Style Prompt Bank

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Image Neural Style Transfer with Preserving the Salient Regions.

Multi-granularity Brushstrokes Network for Universal Style Transfer

Rethinking Neural Style Transfer: Generating Personalized and Watermarked Stylized Images

Towards Highly Realistic Artistic Style Transfer via Stable Diffusion with Step-aware and Layer-aware Prompt

Painterly Style Transfer With Learned Brush Strokes

Attention-Aware Multi-Stroke Style Transfer

Direction-aware neural style transfer with texture enhancement.

Artistic Neural Style Transfer Algorithms with Activation Smoothing

Cvstgan: A Controllable Generative Adversarial Network for Video Style Transfer of Chinese Painting

Structure-Guided Arbitrary Style Transfer for Artistic Image and Video

Scaling Painting Style Transfer

HyperNST: Hyper-Networks for Neural Style Transfer

Geometric Style Transfer