Abstract:We tackle the task of street-to-shop clothing image synthesis. Given a daily person image with a particular clothing item captured in the street scenario, we aim to synthesize the frontal facing view of that item in the shop scenario. This problem has the following challenges: 1) the distinct visual discrepancy between the street and shop scenario; 2) the severe shape deformation of clothing in the presence of an arbitrary human pose; 3) the preservation of fine-grained details during the process of clothing image generation. In this paper, we jointly solve these difficulties by proposing a Pose-Normalized and Appearance-Preserved Generative Adversarial Network (PNAP-GAN). More specifically, conditioned on the clothing-agnostic representation (i.e., clothing landmarks and semantic parsing map), we disentangle the shape and appearance synthesis in a coarse-to-fine framework. Moreover, a semantic embedding loss is introduced to guide the domain transfer in the semantic level (i.e., keeping the clothing attributes). With the synthesized frontal shop image, a pose-normalized representation in complementary to the domain-invariant feature learnt from the original street image are integrated to facilitate the problem of street-to-shop clothing retrieval. Extensive experiments conducted demonstrate the effectiveness of the proposed PNAP-GAN on generating high quality frontal-view images and the excellence of the learnt pose-normalized features on the retrieval task than existing methods. In addition, we demonstrate that the pose-normalized retrieval feature benefits the cross-scenario (i.e., street-to-shop) clothing image generation in a semantic-preserved manner.

Pose- and Attribute-consistent Person Image Synthesis

Part-Preserving Pose Manipulation For Person Image Synthesis

ACGAN: Attribute Controllable Person Image Synthesis GAN for Pose Transfer

PoT-GAN: Pose Transform GAN for Person Image Synthesis.

Symmetrical Siamese Network for Pose-Guided Person Synthesis

Unpaired semantic neural person image synthesis

Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGAN

Pose Guided Fashion Image Synthesis Using Deep Generative Model

Person Image Synthesis in Arbitrary 3D Poses Based on Part Affinity Fields.

PISE-V: person image and video synthesis with decoupled GAN

Person Image Synthesis Through Siamese Generative Adversarial Network

Pose-Normalized and Appearance-Preserved Street-to-Shop Clothing Image Generation and Feature Learning

Attentional pixel-wise deformation for pose-based human image generation

Progressive and Aligned Pose Attention Transfer for Person Image Generation

Progressive Pose Attention Transfer For Person Image Generation

Structure-transformed Texture-enhanced Network for Person Image Synthesis.

Pose-Guided Person Image Synthesis in the Non-Iconic Views.

Precise Correspondence Enhanced GAN for Person Image Generation

PISE: Person Image Synthesis and Editing with Decoupled GAN

Controllable Person Image Synthesis with Pose-Constrained Latent Diffusion

Appearance and Shape Based Image Synthesis by Conditional Variational Generative Adversarial Network