Abstract:Deep models have achieved impressive performance for face hallucination tasks. However, we observe that directly feeding the hallucinated facial images into recog- nition models can even degrade the recognition performance despite the much better visualization quality. In this paper, we address this problem by jointly learning a deep model for two tasks, i.e. face hallucination and recognition. In particular, we design an end-to-end deep convolution network with hallucination sub-network cascaded by recognition sub-network. The recognition sub- network are responsible for producing discriminative feature representations using the hallucinated images as inputs generated by hallucination sub-network. During training, we feed LR facial images into the network and optimize the parameters by minimizing two loss items, i.e. 1) face hallucination loss measured by the pixel wise difference between the ground truth HR images and network-generated images; and 2) verification loss which is measured by the classification error and intra-class distance. We extensively evaluate our method on LFW and YTF datasets. The experimental results show that our method can achieve recognition accuracy 97.95% on 4x down-sampled LFW testing set, outperforming the accuracy 96.35% of conventional face recognition model. And on the more challenging YTF dataset, we achieve recognition accuracy 90.65%, a margin over the recognition accuracy 89.45% obtained by conventional face recognition model on the 4x down-sampled version.

Nearest Feature Line Embedding for Face Hallucination

Multi-pose Face Hallucination Via Neighbor Embedding for Facial Components

Learning Adaptive Local Distance Metric For Face Hallucination

Face Hallucination by Learning Local Distance Metric.

Nearest Manifold Approach for Face Recognition

Face Hallucination Based on Neighbor Embedding Via Illumination Adaptation

Robust Face Hallucination Via Locality-Constrained Nuclear Norm Regularized Regression

Locality-Constrained Double Low-Rank Representation for Effective Face Hallucination

Embedding and Gradient Say Wrong: A White-Box Method for Hallucination Detection

Contextual-Field Supported Iterative Representation for Face Hallucination.

Nuclear Norm Regularized Coding with Local Position-Patch and Nonlocal Similarity for Face Hallucination.

Super-Identity Convolutional Neural Network for Face Hallucination

Self-Enhanced Convolutional Network for Facial Video Hallucination

Deep Joint Face Hallucination and Recognition

Hallucinating facial images and features

Identity-Preserving Face Hallucination via Deep Reinforcement Learning

Face Hallucination Using Deep Collaborative Representation for Local and Non-Local Patches

Face Hallucination Based on Key Parts Enhancement

Face Hallucination Via Semi-Kernel Partial Least Squares

Contrastive Learning with Hallucinating Data for Long-Tailed Face Recognition.

C-Face: Using Compare Face on Face Hallucination for Low-Resolution Face Recognition