Abstract:Artistic style transfer is the task of synthesizing content images with learned artistic styles. Recent studies have shown the potential of Generative Adversarial Networks (GANs) for producing artistically rich stylizations. Despite the promising results, they usually fail to control the generated images' style degree, which is inflexible and limits their applicability for practical use. To address the issue, in this paper, we propose a novel method that for the first time allows adjusting the style degree for existing GAN-based artistic style transfer frameworks in real time after training. Our method introduces two novel modules into existing GAN-based artistic style transfer frameworks: a Style Scaling Injection (SSI) module and a Style Degree Interpretation (SDI) module. The SSI module accepts the value of Style Degree Factor (SDF) as the input and outputs parameters that scale the feature activations in existing models, offering control signals to alter the style degrees of the stylizations. And the SDI module interprets the output probabilities of a multi-scale content-style binary classifier as the style degrees, providing a mechanism to parameterize the style degree of the stylizations. Moreover, we show that after training our method can enable existing GAN-based frameworks to produce over-stylizations. The proposed method can facilitate many existing GAN-based artistic style transfer frameworks with marginal extra training overheads and modifications. Extensive qualitative evaluations on two typical GAN-based style transfer models demonstrate the effectiveness of the proposed method for gaining style degree control for them.

Real-time Image Style Transformation Based on Deep Learning.

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Optimal Transport of Deep Feature for Image Style Transfer

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

Progress and Impediments in Deep Learning-Driven Image Style Transfer

Image neural style transfer: A review

Image Neural Style Transfer with Preserving the Salient Regions.

Advanced Deep Learning Techniques for Image Style Transfer: A Survey

Style Transformer for Image Inversion and Editing

Research on Image Generation and Style Transfer Algorithm Based on Deep Learning

Digital Image Art Style Transfer Algorithm Based on CycleGAN

Image-to-Image Style Transfer Based on the Ghost Module

Deep Learning-Based Application of Image Style Transfer

Real-Time Arbitrary Style Transfer with Convolution Neural Network

Generative Adversarial Networks Combined with Deep Feature Interpolation for Image Style Transfer

A review of deep learning-based image style transfer research

Research and Application of Image Style Transfer Method

Automatic Image Stylization Using Deep Fully Convolutional Networks

Image Style Transformation Based on structure GAN

Deep Learning-Based Image Style Transformation Research on Landscape Paintings of Wei, Jin and North-South Dynasties