Abstract:Arbitrary Style Transfer (AST) aims to transform images by adopting the style from any selected artwork. Nonetheless, the need to accommodate diverse and subjective user preferences poses a significant challenge. While some users wish to preserve distinct content structures, others might favor a more pronounced stylization. Despite advances in feed-forward AST methods, their limited customizability hinders their practical application. We propose a new approach, ArtFusion, which provides a flexible balance between content and style. In contrast to traditional methods reliant on biased similarity losses, ArtFusion utilizes our innovative Dual Conditional Latent Diffusion Probabilistic Models (Dual-cLDM). This approach mitigates repetitive patterns and enhances subtle artistic aspects like brush strokes and genre-specific features. Despite the promising results of conditional diffusion probabilistic models (cDM) in various generative tasks, their introduction to style transfer is challenging due to the requirement for paired training data. ArtFusion successfully navigates this issue, offering more practical and controllable stylization. A key element of our approach involves using a single image for both content and style during model training, all the while maintaining effective stylization during inference. ArtFusion outperforms existing approaches on outstanding controllability and faithful presentation of artistic details, providing evidence of its superior style transfer capabilities. Furthermore, the Dual-cLDM utilized in ArtFusion carries the potential for a variety of complex multi-condition generative tasks, thus greatly broadening the impact of our research.

A color style fusion design method based on generative adversarial networks

Creative and Diverse Artwork Generation Using Adversarial Networks

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Generative Creativity: Adversarial Learning For Bionic Design

A COMPUTATIONAL APPROACH TO GENERATE DESIGN WITH SPECIFIC STYLE

Artificial Intelligence-Empowered Art Education: A Cycle-Consistency Network-Based Model for Creating the Fusion Works of Tibetan Painting Styles

Inspiration Transfer for Intelligent Design: A Generative Adversarial Network with Fashion Attributes Disentanglement

Mixing and Matching Elements for Intelligent Fashion Design: A Generative Adversarial Network with Structure and Texture Disentanglement

Toward Intelligent Interactive Design: A Generation Framework Based on Cross-domain Fashion Elements

Style Image Harmonization Via Global-Local Style Mutual Guided

Culture-inspired Multi-modal Color Palette Generation and Colorization: A Chinese Youth Subculture Case

ColorwAI: Generative Colorways of Textiles through GAN and Diffusion Disentanglement

Personalized hairstyle and hair color editing based on multi-feature fusion

Learning to Disentangle the Colors, Textures, and Shapes of Fashion Items: A Unified Framework

Coloring and fusing architectural sketches by combining a Y‐shaped generative adversarial network and a denoising diffusion implicit model

Towards Vivid and Diverse Image Colorization with Generative Color Prior

CoPaint: Guiding Sketch Painting with Consistent Color and Coherent Generative Adversarial Networks

UGSC‐GAN: User‐guided sketch colorization with deep convolution generative adversarial networks

CA-GAN: Weakly Supervised Color Aware GAN for Controllable Makeup Transfer

Automatic Color Sketch Generation Using Deep Style Transfer

ArtFusion: Controllable Arbitrary Style Transfer using Dual Conditional Latent Diffusion Models