Abstract:Artistic style transfer is the task of synthesizing content images with learned artistic styles. Recent studies have shown the potential of Generative Adversarial Networks (GANs) for producing artistically rich stylizations. Despite the promising results, they usually fail to control the generated images' style degree, which is inflexible and limits their applicability for practical use. To address the issue, in this paper, we propose a novel method that for the first time allows adjusting the style degree for existing GAN-based artistic style transfer frameworks in real time after training. Our method introduces two novel modules into existing GAN-based artistic style transfer frameworks: a Style Scaling Injection (SSI) module and a Style Degree Interpretation (SDI) module. The SSI module accepts the value of Style Degree Factor (SDF) as the input and outputs parameters that scale the feature activations in existing models, offering control signals to alter the style degrees of the stylizations. And the SDI module interprets the output probabilities of a multi-scale content-style binary classifier as the style degrees, providing a mechanism to parameterize the style degree of the stylizations. Moreover, we show that after training our method can enable existing GAN-based frameworks to produce over-stylizations. The proposed method can facilitate many existing GAN-based artistic style transfer frameworks with marginal extra training overheads and modifications. Extensive qualitative evaluations on two typical GAN-based style transfer models demonstrate the effectiveness of the proposed method for gaining style degree control for them.

P$^2$-GAN: Efficient Style Transfer Using Single Style Image

P$^{2}$-GAN: Efficient Stroke Style Transfer Using Single Style Image.

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Creative and Diverse Artwork Generation Using Adversarial Networks

Style Permutation for Diversified Arbitrary Style Transfer

Diversified Patch-based Style Transfer with Shifted Style Normalization

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

Gating PatternPyramid for Diversified Image Style Transfer

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

Gated-GAN: Adversarial Gated Networks for Multi-Collection Style Transfer

Preserving Structural Consistency in Arbitrary Artist and Artwork Style Transfer

Deep Learning-Based Application of Image Style Transfer

Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer

Regional Style Transfer Based on Partial Convolution Generative Adversarial Network

SDP-GAN: Saliency Detail Preservation Generative Adversarial Networks for High Perceptual Quality Style Transfer

Fast Patch-based Style Transfer of Arbitrary Style

A Generative Adversarial Network AMS-CycleGAN for Multi-Style Image Transformation

Circular LBP Prior-Based Enhanced GAN for Image Style Transfer

TET-GAN: Text Effects Transfer via Stylization and Destylization

Puff-Net: Efficient Style Transfer with Pure Content and Style Feature Fusion Network

PP-GAN : Style Transfer from Korean Portraits to ID Photos Using Landmark Extractor with GAN