Abstract:Human face captured at night or in dimly lit environments has become a common practice, accompanied by complex low-light and low-resolution degradations. However, the existing face super-resolution (FSR) technologies and derived cascaded schemes are inadequate to recover credible textures. In this paper, we propose a novel approach that decomposes the restoration task into face structural fidelity maintaining and texture consistency learning. The former aims to enhance the quality of face images while improving the structural fidelity, while the latter focuses on eliminating perturbations and artifacts caused by low-light degradation and reconstruction. Based on this, we develop a novel low-light low-resolution face super-resolution framework. Our method consists of two steps: an illumination correction face super-resolution network (IC-FSRNet) for lighting the face and recovering the structural information, and a detail enhancement model (DENet) for improving facial details, thus making them more visually appealing and easier to analyze. As the relighted regions could provide complementary information to boost face super-resolution and vice versa, we introduce the mutual learning to harness the informative components from relighted regions and reconstruction, and achieve the iterative refinement. In addition, DENet equipped with diffusion probabilistic model is built to further improve face image visual quality. Experiments demonstrate that the proposed joint optimization framework achieves significant improvements in reconstruction quality and perceptual quality over existing two-stage sequential solutions. Code is available at https://github.com/wcy-cs/IC-FSRDENet.

Robust Face Image Super-Resolution via Joint Learning of Subdivided Contextual Model

A Joint Learning Based Face Super Resolution Approach Via Contextual Topological Structure

Robust Face Super-Resolution Via Position Relation Model Based on Global Face Context.

Face Super-Resolution Via Bilayer Contextual Representation

Robust Face Super-Resolution via Patch Network of Global Context Prior

SelFSR: Self-Conditioned Face Super-Resolution in the Wild Via Flow Field Degradation Network

Context-Patch Representation Learning with Adaptive Neighbor Embedding for Robust Face Image Super-Resolution.

Noisy Practical Facial Super-Resolution Method Via Deformable Constrained Model with Small Dataset

Face Super-Resolution Via Progressive-Scale Boosting Network

The face image super-resolution algorithm based on combined representation learning

Robust Face Super-Resolution Via Locality-Constrained Low-Rank Representation

Robust Super-Resolution for Face Images Via Principle Component Sparse Representation and Least Squares Regression.

Low-Light Face Super-resolution Via Illumination, Structure, and Texture Associated Representation

Face Super-Resolution Via Multilayer Locality-Constrained Iterative Neighbor Embedding and Intermediate Dictionary Learning.

Face Super Resolution for VLQ Facial Images Via Parent Patch Matching.

AWCR: Adaptive and Weighted Collaborative Representations for Face Super-Resolution with Context Residual-Learning.

Face Image Superresolution Via Locality Preserving Projection and Sparse Coding.

Robust Super-resolution Algorithm for Low-quality Surveillance Face Images

Structure-Preserving Image Super-resolution Via Contextualized Multi-task Learning.

Face Image Super-Resolution Through Locality-Induced Support Regression

Face Image Super-Resolution Via K-Nn Regularized Collaborative Representation With Importance Reweighting