Abstract:Obtaining a high-quality frontal face image from a low-resolution (LR) non-frontal face image is primarily important for many facial analysis applications. However, mainstreams either focus on super-resolving near-frontal LR faces or frontalizing non-frontal high-resolution (HR) faces. It is desirable to perform both tasks seamlessly for daily-life unconstrained face images. In this paper, we present a novel Vivid Face Hallucination Generative Adversarial Network (VividGAN) for simultaneously super-resolving and frontalizing tiny non-frontal face images. VividGAN consists of coarse-level and fine-level Face Hallucination Networks (FHnet) and two discriminators, i.e., Coarse-D and Fine-D. The coarse-level FHnet generates a frontal coarse HR face and then the fine-level FHnet makes use of the facial component appearance prior, i.e., fine-grained facial components, to attain a frontal HR face image with authentic details. In the fine-level FHnet, we also design a facial component-aware module that adopts the facial geometry guidance as clues to accurately align and merge the frontal coarse HR face and prior information. Meanwhile, two-level discriminators are designed to capture both the global outline of a face image as well as detailed facial characteristics. The Coarse-D enforces the coarsely hallucinated faces to be upright and complete while the Fine-D focuses on the fine hallucinated ones for sharper details. Extensive experiments demonstrate that our VividGAN achieves photo-realistic frontal HR faces, reaching superior performance in downstream tasks, i.e., face recognition and expression classification, compared with other state-of-the-art methods.

Face Hallucination Based on Key Parts Enhancement

Deep CNN Denoiser and Multi-layer Neighbor Component Embedding for Face Hallucination.

Self-Enhanced Convolutional Network for Facial Video Hallucination

Dual-Path Deep Fusion Network for Face Image Hallucination.

Face Hallucination by Attentive Sequence Optimization with Reinforcement Learning

Face Hallucination: Theory and Practice

FH-GAN: Face Hallucination and Recognition using Generative Adversarial Network

Face Hallucination With Finishing Touches

Joint Face Hallucination and Deblurring via Structure Generation and Detail Enhancement

C-Face: Using Compare Face on Face Hallucination for Low-Resolution Face Recognition

Face Hallucination Via Split-Attention in Split-Attention Network

Face hallucination using cascaded super-resolution and identity priors

ATMFN: Adaptive-Threshold-Based Multi-Model Fusion Network for Compressed Face Hallucination

The face image super-resolution algorithm based on combined representation learning

Hallucinating 3d Faces

Super-Identity Convolutional Neural Network for Face Hallucination

Edge-attention network for preserving structure in face super-resolution

Face Hallucination Using Region-Based Deep Convolutional Networks

An Improved Two-Step Approach to Hallucinating Faces

Face Hallucination Based on Neighbor Embedding Via Illumination Adaptation

Multiple Exemplars-based Hallucinationfor Face Super-resolution and Editing