Abstract:The rapid development of generative diffusion models has significantly advanced the field of style transfer. However, most current style transfer methods based on diffusion models typically involve a slow iterative optimization process, e.g., model fine-tuning and textual inversion of style concept. In this paper, we introduce FreeStyle, an innovative style transfer method built upon a pre-trained large diffusion model, requiring no further optimization. Besides, our method enables style transfer only through a text description of the desired style, eliminating the necessity of style images. Specifically, we propose a dual-stream encoder and single-stream decoder architecture, replacing the conventional U-Net in diffusion models. In the dual-stream encoder, two distinct branches take the content image and style text prompt as inputs, achieving content and style decoupling. In the decoder, we further modulate features from the dual streams based on a given content image and the corresponding style text prompt for precise style transfer. Our experimental results demonstrate high-quality synthesis and fidelity of our method across various content images and style text prompts. Compared with state-of-the-art methods that require training, our FreeStyle approach notably reduces the computational burden by thousands of iterations, while achieving comparable or superior performance across multiple evaluation metrics including CLIP Aesthetic Score, CLIP Score, and Preference. We have released the code at: <a class="link-external link-https" href="https://github.com/FreeStyleFreeLunch/FreeStyle" rel="external noopener nofollow">this https URL</a>.

Character Creation Model and Analysis of Figure Painting Fused with Texture Synthesis Style Transfer Algorithm

Artistic Style Transfer with Internal-external Learning and Contrastive Learning

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

Correlation-based and Content-Enhanced Network for Video Style Transfer

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Preserving Structural Consistency in Arbitrary Artist and Artwork Style Transfer

Research on Image Generation and Style Transfer Algorithm Based on Deep Learning

Research and Application of Image Style Transfer Method

Saliency Constrained Arbitrary Image Style Transfer using SIFT and DCNN

Soulstyler: Using Large Language Model to Guide Image Style Transfer for Target Object

A model integrating attention mechanism and generative adversarial network for image style transfer

FreeStyle: Free Lunch for Text-guided Style Transfer using Diffusion Models

An Improved Style Transfer Algorithm Using Feedforward Neural Network for Real-Time Image Conversion

Interactive Artistic Multi-style Transfer.

A review of deep learning-based image style transfer research

Enhance Image Style Transfer with Depth Spatial Modulation.

Deep Attentive Style Transfer for Images with Wavelet Decomposition

Multi-granularity Brushstrokes Network for Universal Style Transfer

Style transfer with target feature palette and attention coloring