Abstract:An unprecedented booming has been witnessed in the research area of artistic style transfer ever since Gatys et al. introduced the neural method. One of the remaining challenges is to balance a trade-off among three critical aspects—speed, flexibility, and quality: (i) the vanilla optimization-based algorithm produces impressive results for arbitrary styles, but is unsatisfyingly slow due to its iterative nature, (ii) the fast approximation methods based on feed-forward neural networks generate satisfactory artistic effects but bound to only a limited number of styles, and (iii) feature-matching methods like AdaIN achieve arbitrary style transfer in a real-time manner but at a cost of the compromised quality. We find it considerably difficult to balance the trade-off well merely using a single feed-forward step and ask, instead, whether there exists an algorithm that could adapt quickly to any style, while the adapted model maintains high efficiency and good image quality. Motivated by this idea, we propose a novel method, coined MetaStyle, which formulates the neural style transfer as a bilevel optimization problem and combines learning with only a few post-processing update steps to adapt to a fast approximation model with satisfying artistic effects, comparable to the optimization-based methods for an arbitrary style. The qualitative and quantitative analysis in the experiments demonstrates that the proposed approach achieves high-quality arbitrary artistic style transfer effectively, with a good trade-off among speed, flexibility, and quality.

Neural Style Transfer with automatic style weight searching

Evaluate and Improve the Quality of Neural Style Transfer.

Artistic Style Transfer with Internal-external Learning and Contrastive Learning

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

Optimal Transport of Deep Feature for Image Style Transfer

Style Permutation for Diversified Arbitrary Style Transfer

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

Image Neural Style Transfer with Preserving the Salient Regions.

A Scale-adaptive Color Preservation Neural Style Transfer Method

Style Decomposition for Improved Neural Style Transfer

HyperNST: Hyper-Networks for Neural Style Transfer

An Improved Style Transfer Algorithm Using Feedforward Neural Network for Real-Time Image Conversion

Multi-scale Neural Style Transfer Based on Deep Semantic Matching.

Neural Stereoscopic Image Style Transfer

Artistic Neural Style Transfer Algorithms with Activation Smoothing

Style Creation: Multiple Styles Transfer with Incremental Learning and Distillation Loss

Neural Style Transfer Via Meta Networks

MetaStyle: Three-Way Trade-Off among Speed, Flexibility, and Quality in Neural Style Transfer

Geometric Style Transfer

Soft multimodal style transfer via optimal transport

Style is a Distribution of Features