Abstract:Face hallucination methods based on low-resolution (LR) and high-resolution (HR) dictionary pair scheme infer HR patches by directly reusing coding coefficients trained by LR patches over LR dictionary. This scheme implies that LR and HR patch manifolds share highly similar local geometric structure. However, latest preliminary studies argue that the manifold assumption does not hold well such that face hallucination performance inevitably suffers from inconsistency of coding coefficients between LR and HR patches. In this paper, we are the first to observe that coding coefficients of LR patches are more relevant to latent those of HR patches under conditions of involving small magnifying factor. On the basis of this finding, we suggest a stepwise reconstruction scheme to minimize inconsistency risk in solution space. In particular, this scheme divides face hallucination process into multiple cascaded incremental training-synthesis steps, in which each individual step allows smaller magnifying factor as well as the corresponding intermediate resolution (IR) dictionary rather than merely LR and HR dictionary based learning. Moreover, in order to keep sparse representation (SR) sufficiently sparse while favoring its locality, we introduce a weighted ℓ1/ℓ2 mixed norms minimization SR method and formulate a unified framework together with stepwise scheme. Experiments on commonly used face database demonstrate that our framework achieves state-of-the-art results.

Face hallucination based on stepwise sparse reconstruction

Face hallucination via K-selection mean constrained sparse representation

Global consistency, local sparsity and pixel correlation: A unified framework for face hallucination

Face hallucination via Cauchy regularized sparse representation

Contextual-Field Supported Iterative Representation for Face Hallucination.

Face Hallucination via KNN Sparse Coding Mean Constrained

Face hallucination via position-based dictionaries coding in kernel feature space

Face hallucination based on PCA dictionary pairs

Face Hallucination in a High Resolution Feature Space Using an Intermediate Dictionary Learning Via Reference Patch Embedding

Face Hallucination VIA Sparse Coding.

Position-Patch Based Face Hallucination via High-Resolution Reconstructed-Weights Representation.

Face Hallucination Via Multi-Scale Structure Prior Learning

Face Hallucination Based on Modified Neighbor Embedding and Global Smoothness Constraint.

Face hallucination with imprecise-alignment using iterative sparse representation.

Hallucinating Faces: LPH Super-Resolution and Neighbor Reconstruction for Residue Compensation.

A face hallucination method via HR-LLE coefficients constraint

Group Embedding for Face Hallucination

Supervised-learning Based Face Hallucination for Enhancing Face Recognition.

Support-driven sparse coding for face hallucination

Face Hallucination Using Deep Collaborative Representation for Local and Non-Local Patches

Face Hallucination Via Weighted Sparse Representation