Abstract:Artistic style transfer is the task of synthesizing content images with learned artistic styles. Recent studies have shown the potential of Generative Adversarial Networks (GANs) for producing artistically rich stylizations. Despite the promising results, they usually fail to control the generated images' style degree, which is inflexible and limits their applicability for practical use. To address the issue, in this paper, we propose a novel method that for the first time allows adjusting the style degree for existing GAN-based artistic style transfer frameworks in real time after training. Our method introduces two novel modules into existing GAN-based artistic style transfer frameworks: a Style Scaling Injection (SSI) module and a Style Degree Interpretation (SDI) module. The SSI module accepts the value of Style Degree Factor (SDF) as the input and outputs parameters that scale the feature activations in existing models, offering control signals to alter the style degrees of the stylizations. And the SDI module interprets the output probabilities of a multi-scale content-style binary classifier as the style degrees, providing a mechanism to parameterize the style degree of the stylizations. Moreover, we show that after training our method can enable existing GAN-based frameworks to produce over-stylizations. The proposed method can facilitate many existing GAN-based artistic style transfer frameworks with marginal extra training overheads and modifications. Extensive qualitative evaluations on two typical GAN-based style transfer models demonstrate the effectiveness of the proposed method for gaining style degree control for them.

Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artworks

Creative and Diverse Artwork Generation Using Adversarial Networks

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

SIMGAN: Photo-Realistic Semantic Image Manipulation Using Generative Adversarial Networks.

Style Permutation for Diversified Arbitrary Style Transfer

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

SmartPaint: a Co-Creative Drawing System Based on Generative Adversarial Networks

Improving Semantic Style Transfer Using Guided Gram Matrices.

Automatic Semantic Style Transfer using Deep Convolutional Neural Networks and Soft Masks

Multi-scale Neural Style Transfer Based on Deep Semantic Matching.

Automatic Color Sketch Generation Using Deep Style Transfer

Semantic Draw Engineering for Text-to-Image Creation

PortraitNET: Photo-realistic portrait cartoon style transfer with self-supervised semantic supervision

Respecting Low-Level Components of Content with Skip Connections and Semantic Information in Image Style Transfer

Rethinking Style Transfer: From Pixels to Parameterized Brushstrokes

Semantic-related image style transfer with dual-consistency loss.

Exemplar-Based Image and Video Stylization Using Fully Convolutional Semantic Features.

Learning to Manipulate Artistic Images

D2Styler: Advancing Arbitrary Style Transfer with Discrete Diffusion Methods

GAN-based AI Drawing Board for Image Generation and Colorization

Research on Image Generation and Style Transfer Algorithm Based on Deep Learning