Abstract:In this paper, we propose Occlusion-Aware Warping GAN (OAW-GAN), a unified Human Video Synthesis (HVS) framework that can uniformly tackle human video motion transfer, attribute editing, as well as inpainting. This is the first work to our knowledge that can handle all these tasks within a one-time trained model. Although existing GAN-based HVS methods have achieved great success, they either can’t preserve appearance details due to the loss of spatial consistency between the synthesized target frames and the input source images, or generate incoherent video results due to the loss of temporal consistency among frames. Besides, most of them lack the ability to create new contents while keeping existing ones, failing especially when some regions in the target are invisible in the source due to self-occlusion. To address these limitations, we first introduce Coarse-to-Fine Flow Warping Network (C2F-FWN) to estimate spatial-temporal consistent transformation between source and target, as well as occlusion mask indicating which parts in the target are invisible in the source. Then, the flow and the mask are scaled and fed into the pyramidal stages of our OAW-GAN, guiding Occlusion-Aware Synthesis (OAS) that can be abstracted into visible part re-utilization and invisible part inpainting at the feature level, which effectively alleviates the self-occlusion problem. Extensive experiments conducted on both human video (i.e., iPER, SoloDance)Keywords are desired. please provide if necessary. and image (i.e., DeepFashion) datasets demonstrate the superiority of our approach to existing state-of-the-arts. We also show that, besides motion transfer task that previous works concern, our framework can further achieve attribute editing and texture inpainting, which paves the way towards unified HVS.

Pose Invariant Age Estimation of Face Images in the Wild

OAW-GAN: Occlusion-Aware Warping GAN for Unified Human Video Synthesis

Realistic Face Reenactment Via Self-Supervised Disentangling of Identity and Pose

UVA: A Universal Variational Framework for Continuous Age Analysis

Attribute-aware Face Aging with Wavelet-based Generative Adversarial Networks

Age-Invariant Face Embedding using the Wasserstein Distance

P-Age: Pexels Dataset for Robust Spatio-Temporal Apparent Age Classification

AgingMapGAN (AMGAN): High-Resolution Controllable Face Aging with Spatially-Aware Conditional GANs

Unified Video and Image Representation for Boosted Video Face Forgery Detection

Age Estimation From Human Body Images

Multifeature Anisotropic Orthogonal Gaussian Process for Automatic Age Estimation

Age Estimation of Faces in Videos Using Head Pose Estimation and Convolutional Neural Networks

Global and Local Consistent Wavelet-domain Age Synthesis

Wasserstein Divergence GAN With Cross-Age Identity Expert and Attribute Retainer for Facial Age Transformation

Face aging with conditional generative adversarial networks

Age Simulation for Face Recognition

Age Gap Reducer-GAN for Recognizing Age-Separated Faces

Look across Elapse: Disentangled Representation Learning and Photorealistic Cross-Age Face Synthesis for Age-Invariant Face Recognition

Continuous Face Aging via Self-estimated Residual Age Embedding

Video Face Re-Aging: Toward Temporally Consistent Face Re-Aging

Enhance Gender and Identity Preservation in Face Aging Simulation for Infants and Toddlers