Abstract:Garment transfer aims to transfer the desired garment from a model image with the desired clothing to a target person, which has attracted a great deal of attention due to its wider potential applications. However, considering the model and target persons are often given at different views, body shapes and poses, realistic garment transfer is facing the following challenges that have not been well addressed: 1) deforming the garment; 2) inferring unobserved appearance; 3) preserving fine texture details. To tackle these challenges, we propose a novel SPatial-Aware Texture Transformer (SPATT) model. Different from existing models, SPATT establishes correspondence and infers unobserved clothing appearance by leveraging the spatial prior information of a UV-space. Specifically, the source image is transformed into a partial UV texture map guided by the extracted dense pose. To better infer the unseen appearance utilizing seen region, we first propose a novel coordinate-prior map that defines the spatial relationship between the coordinates in the UV texture map, and design an algorithm to compute it. Based on the proposed coordinate-prior map, we present a novel spatial-aware texture generation network to complete the partial UV texture. In the second stage, we first transform the completed UV texture to fit the target person. To polish the details and improve realism, we introduce a refinement generative network conditioned on the warped image and source input. Compared with existing frameworks as shown experimentally, the proposed framework can generate more realistic images with better-preserved texture details. Furthermore, difficult cases where two persons have large pose and view differences can also be well handled by SPATT.

Toward Accurate and Realistic Garment Texture Transfer with Attention to Details

Modeling and Realization of Image-Based Garment Texture Transfer

Spatial-Aware Texture Transformer for High-Fidelity Garment Transfer.

Apparel Products Simulation Using Texture Mapping with Color Fidelity.

An Integrated Method of 3D Garment Design

FabricDiffusion: High-Fidelity Texture Transfer for 3D Garments Generation from In-The-Wild Clothing Images

Learning to Transfer Texture from Clothing Images to 3D Humans

Shape-preserving Swapping Autoencoder for Garment Texture Transfer

Detailed Garment Recovery from a Single-View Image

Automatic Pose and Wrinkle Transfer for Aesthetic Garment Display

A Novel Garment Transfer Method Supervised by Distilled Knowledge of Virtual Try-on Model

Pattern Guided UV Recovery for Realistic Video Garment Texturing

DeepIron: Predicting Unwarped Garment Texture from a Single Image

Robust 3D Garment Digitization from Monocular 2D Images for 3D Virtual Try-On Systems

Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-On

3D Garment Digitisation for Virtual Wardrobe Using a Commodity Depth Sensor.

GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details

Cloth2Tex: A Customized Cloth Texture Generation Pipeline for 3D Virtual Try-On

Deep Detail Enhancement for Any Garment

Automatic Realistic 3D Garment Generation Based on Two Images