Abstract:Face hallucination methods based on low-resolution (LR) and high-resolution (HR) dictionary pair scheme infer HR patches by directly reusing coding coefficients trained by LR patches over LR dictionary. This scheme implies that LR and HR patch manifolds share highly similar local geometric structure. However, latest preliminary studies argue that the manifold assumption does not hold well such that face hallucination performance inevitably suffers from inconsistency of coding coefficients between LR and HR patches. In this paper, we are the first to observe that coding coefficients of LR patches are more relevant to latent those of HR patches under conditions of involving small magnifying factor. On the basis of this finding, we suggest a stepwise reconstruction scheme to minimize inconsistency risk in solution space. In particular, this scheme divides face hallucination process into multiple cascaded incremental training-synthesis steps, in which each individual step allows smaller magnifying factor as well as the corresponding intermediate resolution (IR) dictionary rather than merely LR and HR dictionary based learning. Moreover, in order to keep sparse representation (SR) sufficiently sparse while favoring its locality, we introduce a weighted ℓ1/ℓ2 mixed norms minimization SR method and formulate a unified framework together with stepwise scheme. Experiments on commonly used face database demonstrate that our framework achieves state-of-the-art results.

Face Hallucination Based on Modified Neighbor Embedding and Global Smoothness Constraint.

Modified Neighbor Embedding-Based Face Hallucination Using Coupled Mappings of Partial Least Squares

Locality Preserving Partial Least Squares for Neighbor Embedding-Based Face Hallucination

Face Hallucination Using Correlative Residue Compensation in a Modified Feature Space.

Face Hallucination Based on Degradation Analysis for Robust Manifold

Face Hallucination in a High Resolution Feature Space Using an Intermediate Dictionary Learning Via Reference Patch Embedding

Facial Image Hallucination through Coupled-Layer Neighbor Embedding

Surveillance Face Hallucination Via Variable Selection and Manifold Learning.

Group Embedding for Face Hallucination

Locality-constraint iterative neighbor embedding for face hallucination

A Joint Learning Based Face Hallucination Approach For Low Quality Face Image

Face Hallucination Using Manifold-Regularized Group Locality-Constrained Representation

Aligning Coupled Manifolds for Face Hallucination

Hallucinating Faces: LPH Super-Resolution and Neighbor Reconstruction for Residue Compensation.

Face Hallucination Via Re-Identified K-nearest Neighbors Embedding

Face hallucination with imprecise-alignment using iterative sparse representation.

A face hallucination method via HR-LLE coefficients constraint

Face Hallucination Via Semi-Kernel Partial Least Squares

Coupled-Layer Neighbor Embedding for Surveillance Face Hallucination

Face hallucination based on stepwise sparse reconstruction

Face Hallucination Based on Neighbor Embedding Via Illumination Adaptation