Abstract:In this paper, we present an end-to-end approach to generate high-resolution person images conditioned on texts only. State-of-the-art text-to-image generation models are mainly designed for center-object generation, e.g., flowers and birds. Unlike center-placed objects with similar shapes and orientation, person image generation is a more challenging task, for which we observe the followings: 1) the generated images for the same person exhibit visual details with identity-consistency, e.g., identity-related textures/clothes/shoes across the images, and 2) those images should be discriminant for being robust against the inter-person variations caused by visual ambiguities. To address the above challenges, we develop an effective generative model to produce person images with two novel mechanisms. In particular, our first mechanism (called T-Person-GAN-ID) is to integrate the one-stream generator with an identity-preserving network such that the representations of generated data are regularized in their feature space to ensure the identity-consistency. The second mechanism (called T-Person-GAN-ID-MM) is based on the manifold mix-up to produce mixed images via the linear interpolation across generated images from different manifold identities, and we further enforce such interpolated images to be linearly classified in the feature space. This amounts to learning a linear classification boundary that can perfectly separate images from two identities. Our proposed method is empirically validated to achieve a remarkable improvement in text-to-person image generation. Our architecture is orthogonal to StackGAN++ , and focuses on person image generation, with all of them together to enrich the spectrum of GANs for the image generation task. Codes are available on \url{<a class="link-external link-https" href="https://github.com/linwu-github/Person-Image-Generation.git" rel="external noopener nofollow">this https URL</a>}.

Generative Cooperative Network for Person Image Generation.

CoGAN: Cooperatively Trained Conditional and Unconditional GAN for Person Image Generation.

Generative Cooperative Net for Image Generation and Data Augmentation.

Pose and Color-Gamut Guided Generative Adversarial Network for Pedestrian Image Synthesis

XingGAN for Person Image Generation

Precise Correspondence Enhanced GAN for Person Image Generation

Mutually Activated Residual Linear Modeling GAN for Pose-Guided Person Image Generation

T-Person-GAN: Text-to-Person Image Generation with Identity-Consistency and Manifold Mix-Up

Progressive Pose Attention Transfer For Person Image Generation

Semantic Constraint GAN for Person Re-Identification in Camera Sensor Networks

Verbal-Person Nets: Pose-Guided Multi-Granularity Language-to-Person Generation

Progressive and Aligned Pose Attention Transfer for Person Image Generation

An adversarial human pose estimation network injected with graph structure

CDE-GAN: Cooperative Dual Evolution Based Generative Adversarial Network

PoT-GAN: Pose Transform GAN for Person Image Synthesis.

PCGAN: Partition-Controlled Human Image Generation

Pedestrian-Synthesis-GAN: Generating Pedestrian Data in Real Scene and Beyond

Bipartite Graph Reasoning GANs for Person Image Generation

A Unified Generative Adversarial Framework for Image Generation and Person Re-identification.

MGD-GAN: Text-to-Pedestrian Generation Through Multi-grained Discrimination

Person Image Synthesis Through Siamese Generative Adversarial Network