Abstract:The process of fashion design involves creative expression through various methods, including sketch drawing, brush painting, and choices of textures and colors, all of which are employed to characterize the originality and uniqueness of the designed fashion items. Despite recent advances in intelligence-driven fashion design, the complexity of the diverse elements of a fashion item, such as its texture, color and shape, which are associated with the semantic information conveyed, continues to present challenges in terms of generating high-quality fashion images as well as achieving a controllable editing process. To address this issue, we propose a unified framework, FashionDiff, that leverages the diverse elements in fashion items to generate new items. Initially, we collected a large number of fashion images with multiple categories and created pairwise data in terms of sketch and additional data, such as brush areas, textures, or colors. To eliminate semantic discrepancies between these pairwise datasets, we introduce a feature modulation fusion (FMFusion) process, which enables interactive communication among different images, allowing them to be fused into latent spaces characterized by different resolutions. In order to produce high-quality editable fashion images, we develop a generator based on a state-of-the-art diffusion model called FD-ControlNet, which integrates latent spaces into different layers of the generator to generate ready-to-wear fashion items. Qualitative and quantitative experimental results demonstrate the effectiveness of our proposed method, and suggest that our model can offer flexible control over the generated images in terms of sketches, brush areas, textures, and colors.

Inspiration Transfer for Intelligent Design: A Generative Adversarial Network with Fashion Attributes Disentanglement

Texture Brush for Fashion Inspiration Transfer: A Generative Adversarial Network with Heatmap-Guided Semantic Disentanglement

Image Reference-guided Fashion Design with Structure-aware Transfer by Diffusion Models.

Toward Intelligent Fashion Design: A Texture and Shape Disentangled Generative Adversarial Network

InspirNET: an Unsupervised Generative Adversarial Network with Controllable Fine-grained Texture Disentanglement for Fashion Generation

Learning to Disentangle the Colors, Textures, and Shapes of Fashion Items: A Unified Framework

Mixing and Matching Elements for Intelligent Fashion Design: A Generative Adversarial Network with Structure and Texture Disentanglement

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Shape-preserving Swapping Autoencoder for Garment Texture Transfer

Toward Intelligent Design: an AI-Based Fashion Designer Using Generative Adversarial Networks Aided by Sketch and Rendering Generators.

Garment Design with Generative Adversarial Networks

SwapGAN: A Multistage Generative Approach for Person-to-Person Fashion Style Transfer

FACT: Fused Attention for Clothing Transfer with Generative Adversarial Networks

A Novel DAGAN for Synthesizing Garment Images Based on Design Attribute Disentangled Representation

FashionDiff: A Controllable Diffusion Model Using Pairwise Fashion Elements for Intelligent Design

Toward AI fashion design: An Attribute-GAN model for clothing match

Toward Intelligent Interactive Design: A Generation Framework Based on Cross-domain Fashion Elements

GarmentGAN: Photo-realistic Adversarial Fashion Transfer

Generative Attribute Manipulation Scheme for Flexible Fashion Search

Would Your Clothes Look Good on Me? Towards Transferring Clothing Styles with Adaptive Instance Normalization

DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Models