Abstract:We tackle the task of street-to-shop clothing image synthesis. Given a daily person image with a particular clothing item captured in the street scenario, we aim to synthesize the frontal facing view of that item in the shop scenario. This problem has the following challenges: 1) the distinct visual discrepancy between the street and shop scenario; 2) the severe shape deformation of clothing in the presence of an arbitrary human pose; 3) the preservation of fine-grained details during the process of clothing image generation. In this paper, we jointly solve these difficulties by proposing a Pose-Normalized and Appearance-Preserved Generative Adversarial Network (PNAP-GAN). More specifically, conditioned on the clothing-agnostic representation (i.e., clothing landmarks and semantic parsing map), we disentangle the shape and appearance synthesis in a coarse-to-fine framework. Moreover, a semantic embedding loss is introduced to guide the domain transfer in the semantic level (i.e., keeping the clothing attributes). With the synthesized frontal shop image, a pose-normalized representation in complementary to the domain-invariant feature learnt from the original street image are integrated to facilitate the problem of street-to-shop clothing retrieval. Extensive experiments conducted demonstrate the effectiveness of the proposed PNAP-GAN on generating high quality frontal-view images and the excellence of the learnt pose-normalized features on the retrieval task than existing methods. In addition, we demonstrate that the pose-normalized retrieval feature benefits the cross-scenario (i.e., street-to-shop) clothing image generation in a semantic-preserved manner.

Pose-Normalized and Appearance-Preserved Street-to-Shop Clothing Image Generation and Feature Learning

Pose- and Attribute-consistent Person Image Synthesis

Towards Photo-Realistic Virtual Try-On by Adaptively Generating$\leftrightarrow$Preserving Image Content

Towards Photo-Realistic Virtual Try-On by Adaptively Generating↔Preserving Image Content

Collocated Clothing Synthesis with GANs Aided by Textual Information: A Multi-Modal Framework

PAINT: Photo-realistic Fashion Design Synthesis

Pose Guided Fashion Image Synthesis Using Deep Generative Model

Attentional pixel-wise deformation for pose-based human image generation

Virtually Trying on New Clothing with Arbitrary Poses

BC-GAN: A Generative Adversarial Network for Synthesizing a Batch of Collocated Clothing

BCNet: Learning Body and Cloth Shape from A Single Image

GarmentGAN: Photo-realistic Adversarial Fashion Transfer

Poly-GAN: Multi-Conditioned GAN for Fashion Synthesis

GAN-Based Garment Generation Using Sewing Pattern Images

PaintNet: A shape-constrained generative framework for generating clothing from fashion model

Precise Correspondence Enhanced GAN for Person Image Generation

Pose-Normalized Image Generation for Person Re-identification

PoshakNet: Framework for matching dresses from real-life photos using GAN and Siamese Network

SwapGAN: A Multistage Generative Approach for Person-to-Person Fashion Style Transfer

ClothingOut: a category-supervised GAN model for clothing segmentation and retrieval

Pose and Color-Gamut Guided Generative Adversarial Network for Pedestrian Image Synthesis