Abstract:Hallucinating a photo-realistic frontal face image from a low-resolution (LR) non-frontal face image is beneficial for a series of face-related applications. However, previous efforts either focus on super-resolving high-resolution (HR) face images from nearly frontal LR counterparts or frontalizing non-frontal HR faces. It is necessary to address all these challenges jointly for real-world face images in unconstrained environment. In this paper, we develop a novel Cross-view Information Interaction and Feedback Network (CVIFNet), which simultaneously handles the non-frontal LR face image super-resolution (SR) and frontalization in a unified framework and interacts them with each other to further improve their performance. Specifically, the CVIFNet is composed of two feedback sub-networks for frontal and profile face images. Considering the reliable correspondence between frontal and non-frontal face images can be crucial and contribute to face hallucination in a different manner, we design a cross-view information interaction module (CVIM) to aggregate HR representations of different views produced by the SR and frontalization processes to generate finer face hallucination results. Besides, since 3D rendered facial priors contain rich hierarchical features, such as low-level (e.g., sharp edge and illumination) and perception level (e.g., identity) information, we design an identity-preserving consistency loss based on 3D rendered facial priors, which can ensure that the high-frequency details of frontal face hallucination result are consistent with the profile. Extensive experiments demonstrate the effectiveness and advancement of CVIFNet.

Classifying Facial Regions for Face Hallucination

Face Hallucination Using Region-Based Deep Convolutional Networks

Parallel Region-Based Deep Residual Networks for Face Hallucination.

C-Face: Using Compare Face on Face Hallucination for Low-Resolution Face Recognition

Face Hallucination Via Split-Attention in Split-Attention Network

Deep CNN Denoiser and Multi-layer Neighbor Component Embedding for Face Hallucination.

Self-Enhanced Convolutional Network for Facial Video Hallucination

FaceFormer: Aggregating Global and Local Representation for Face Hallucination

Cross-view Information Interaction and Feedback Network for Face Hallucination

Adaptive Aggregation Network for Face Hallucination

Face Hallucination Based on Key Parts Enhancement

Attention-Aware Face Hallucination Via Deep Reinforcement Learning.

Super-Identity Convolutional Neural Network for Face Hallucination

ATMFN: Adaptive-Threshold-Based Multi-Model Fusion Network for Compressed Face Hallucination

Face Hallucination By Deep Traversal Network

Global consistency, local sparsity and pixel correlation: A unified framework for face hallucination

Face Hallucination Via Multi-Scale Structure Prior Learning

Discriminative Face Hallucination Via Locality-Constrained and Category Embedding Representation.

Face Hallucination VIA Sparse Coding.

Hallucinating Faces: LPH Super-Resolution and Neighbor Reconstruction for Residue Compensation.

Face Hallucination: Theory and Practice