Abstract:Hallucinating a photo-realistic frontal face image from a low-resolution (LR) non-frontal face image is beneficial for a series of face-related applications. However, previous efforts either focus on super-resolving high-resolution (HR) face images from nearly frontal LR counterparts or frontalizing non-frontal HR faces. It is necessary to address all these challenges jointly for real-world face images in unconstrained environment. In this paper, we develop a novel Cross-view Information Interaction and Feedback Network (CVIFNet), which simultaneously handles the non-frontal LR face image super-resolution (SR) and frontalization in a unified framework and interacts them with each other to further improve their performance. Specifically, the CVIFNet is composed of two feedback sub-networks for frontal and profile face images. Considering the reliable correspondence between frontal and non-frontal face images can be crucial and contribute to face hallucination in a different manner, we design a cross-view information interaction module (CVIM) to aggregate HR representations of different views produced by the SR and frontalization processes to generate finer face hallucination results. Besides, since 3D rendered facial priors contain rich hierarchical features, such as low-level (e.g., sharp edge and illumination) and perception level (e.g., identity) information, we design an identity-preserving consistency loss based on 3D rendered facial priors, which can ensure that the high-frequency details of frontal face hallucination result are consistent with the profile. Extensive experiments demonstrate the effectiveness and advancement of CVIFNet.

Parsing Map Guided Multi-Scale Attention Network For Face Hallucination

Face Hallucination Via Multi-Scale Structure Prior Learning

Attention-Aware Face Hallucination Via Deep Reinforcement Learning.

Face Hallucination by Attentive Sequence Optimization with Reinforcement Learning

Parallel Region-Based Deep Residual Networks for Face Hallucination.

Dual-Path Deep Fusion Network for Face Image Hallucination.

Face Hallucination By Deep Traversal Network

Adaptive Aggregation Network for Face Hallucination

MAP-Based Two-Step Approach to Hallucinating Faces

ATMFN: Adaptive-Threshold-Based Multi-Model Fusion Network for Compressed Face Hallucination

C-Face: Using Compare Face on Face Hallucination for Low-Resolution Face Recognition

Deep CNN Denoiser and Multi-layer Neighbor Component Embedding for Face Hallucination.

Progressive Local-to-global Vision Transformer for Occluded Face Hallucination

Self-Enhanced Convolutional Network for Facial Video Hallucination

Cross-view Information Interaction and Feedback Network for Face Hallucination

Face Hallucination Via Split-Attention in Split-Attention Network

Heatmap-Aware Pyramid Face Hallucination.

Face Hallucination Based on Key Parts Enhancement

Supervised-learning Based Face Hallucination for Enhancing Face Recognition.

Face Hallucination Via Multiple Feature Learning with Hierarchical Structure

Face Hallucination Using Region-Based Deep Convolutional Networks