Abstract:Artistic style transfer is the task of synthesizing content images with learned artistic styles. Recent studies have shown the potential of Generative Adversarial Networks (GANs) for producing artistically rich stylizations. Despite the promising results, they usually fail to control the generated images' style degree, which is inflexible and limits their applicability for practical use. To address the issue, in this paper, we propose a novel method that for the first time allows adjusting the style degree for existing GAN-based artistic style transfer frameworks in real time after training. Our method introduces two novel modules into existing GAN-based artistic style transfer frameworks: a Style Scaling Injection (SSI) module and a Style Degree Interpretation (SDI) module. The SSI module accepts the value of Style Degree Factor (SDF) as the input and outputs parameters that scale the feature activations in existing models, offering control signals to alter the style degrees of the stylizations. And the SDI module interprets the output probabilities of a multi-scale content-style binary classifier as the style degrees, providing a mechanism to parameterize the style degree of the stylizations. Moreover, we show that after training our method can enable existing GAN-based frameworks to produce over-stylizations. The proposed method can facilitate many existing GAN-based artistic style transfer frameworks with marginal extra training overheads and modifications. Extensive qualitative evaluations on two typical GAN-based style transfer models demonstrate the effectiveness of the proposed method for gaining style degree control for them.

Learning Layout and Style Reconfigurable GANs for Controllable Image Synthesis

Image Synthesis From Reconfigurable Layout and Style

Image Synthesis from Layout with Locality-Aware Mask Adaption

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Interactive Image Synthesis with Panoptic Layout Generation

Customizable GAN: Customizable Image Synthesis Based on Adversarial Learning.

Composition-aware Graphic Layout GAN for Visual-textual Presentation Designs

LayoutGAN: Synthesizing Graphic Layouts with Vector-Wireframe Adversarial Networks

EL-GAN: Edge-Enhanced Generative Adversarial Network for Layout-to-Image Generation

LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators

Layout2image: Image Generation from Layout

Attribute-Conditioned Layout GAN for Automatic Graphic Design

Object-driven Text-to-Image Synthesis via Adversarial Training

ALR-GAN: Adaptive Layout Refinement for Text-to-Image Synthesis

Learning What and Where to Draw

LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generation

LayoutGPT: Compositional Visual Planning and Generation with Large Language Models

Spatially Constrained GAN for Face and Fashion Synthesis.

Style Separation and Synthesis Via Generative Adversarial Networks

DensityLayout: Density-Conditioned Layout GAN for Visual-Textual Presentation Designs.

Towards Spatially Disentangled Manipulation of Face Images With Pre-Trained StyleGANs