Abstract:Artistic style transfer is the task of synthesizing content images with learned artistic styles. Recent studies have shown the potential of Generative Adversarial Networks (GANs) for producing artistically rich stylizations. Despite the promising results, they usually fail to control the generated images' style degree, which is inflexible and limits their applicability for practical use. To address the issue, in this paper, we propose a novel method that for the first time allows adjusting the style degree for existing GAN-based artistic style transfer frameworks in real time after training. Our method introduces two novel modules into existing GAN-based artistic style transfer frameworks: a Style Scaling Injection (SSI) module and a Style Degree Interpretation (SDI) module. The SSI module accepts the value of Style Degree Factor (SDF) as the input and outputs parameters that scale the feature activations in existing models, offering control signals to alter the style degrees of the stylizations. And the SDI module interprets the output probabilities of a multi-scale content-style binary classifier as the style degrees, providing a mechanism to parameterize the style degree of the stylizations. Moreover, we show that after training our method can enable existing GAN-based frameworks to produce over-stylizations. The proposed method can facilitate many existing GAN-based artistic style transfer frameworks with marginal extra training overheads and modifications. Extensive qualitative evaluations on two typical GAN-based style transfer models demonstrate the effectiveness of the proposed method for gaining style degree control for them.

TH-GAN: Generative Adversarial Network Based Transfer Learning for Historical Chinese Character Recognition

Creative and Diverse Artwork Generation Using Adversarial Networks

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Chinese character style transfer based on multi-scale GAN

AGTGAN: Unpaired Image Translation for Photographic Ancient Character Generation

CNN Based Transfer Learning for Historical Chinese Character Recognition

GAN-Based Unpaired Chinese Character Image Translation Via Skeleton Transformation and Stroke Rendering.

CS-GAN: Cross-Structure Generative Adversarial Networks for Chinese Calligraphy Translation.

Gaussian Process Style Transfer Mapping for Historical Chinese Character Recognition

CT-GAN: A conditional Generative Adversarial Network of transformer architecture for text-to-image

Occluded offline handwritten Chinese character recognition using deep convolutional generative adversarial network and improved GoogLeNet

Gated-GAN: Adversarial Gated Networks for Multi-Collection Style Transfer

Dual Discriminator GAN: Restoring Ancient Yi Characters

ZiGAN: Fine-grained Chinese Calligraphy Font Generation via a Few-shot Style Transfer Approach

ChipGAN: A Generative Adversarial Network for Chinese Ink Wash Painting Style Transfer.

DLP-GAN: learning to draw modern Chinese landscape photos with generative adversarial network

KT-GAN: Knowledge-Transfer Generative Adversarial Network for Text-to-Image Synthesis

GestureGAN for Hand Gesture-to-Gesture Translation in the Wild

Recent Advances of Generative Adversarial Networks in Computer Vision

Arbitrary Handwriting Image Style Transfer

Generative Adversarial Network for Handwritten Text