Abstract:Human face captured at night or in dimly lit environments has become a common practice, accompanied by complex low-light and low-resolution degradations. However, the existing face super-resolution (FSR) technologies and derived cascaded schemes are inadequate to recover credible textures. In this paper, we propose a novel approach that decomposes the restoration task into face structural fidelity maintaining and texture consistency learning. The former aims to enhance the quality of face images while improving the structural fidelity, while the latter focuses on eliminating perturbations and artifacts caused by low-light degradation and reconstruction. Based on this, we develop a novel low-light low-resolution face super-resolution framework. Our method consists of two steps: an illumination correction face super-resolution network (IC-FSRNet) for lighting the face and recovering the structural information, and a detail enhancement model (DENet) for improving facial details, thus making them more visually appealing and easier to analyze. As the relighted regions could provide complementary information to boost face super-resolution and vice versa, we introduce the mutual learning to harness the informative components from relighted regions and reconstruction, and achieve the iterative refinement. In addition, DENet equipped with diffusion probabilistic model is built to further improve face image visual quality. Experiments demonstrate that the proposed joint optimization framework achieves significant improvements in reconstruction quality and perceptual quality over existing two-stage sequential solutions. Code is available at https://github.com/wcy-cs/IC-FSRDENet.

Coarse-to-fine Face Depth Super-Resolution with Attentive Feature Selection.

Coarse-to-Fine Depth Super-Resolution with Adaptive RGB-D Feature Attention

Face Super-Resolution Via Progressive-Scale Boosting Network

Edge-guided Single Facial Depth Map Super-Resolution Using CNN.

MFFNet: Single facial depth map refinement using multi-level feature fusion

Feature Agglomeration Networks for Single Stage Face Detection

Low-Light Face Super-resolution Via Illumination, Structure, and Texture Associated Representation

Joint-Feature Guided Depth Map Super-Resolution with Face Priors

Deep Color Guided Coarse-to-Fine Convolutional Network Cascade for Depth Image Super-Resolution.

FCFR-Net: Feature Fusion based Coarse-to-Fine Residual Learning for Depth Completion

Face Super-Resolution with Progressive Embedding of Multi-scale Face Priors

Adaptive Feature Denoising Based Deep Convolutional Network for Single Image Super-Resolution

Multi-Scale Frequency Reconstruction for Guided Depth Map Super-Resolution Via Deep Residual Network

Refining Single Low-Quality Facial Depth Map by Lightweight and Efficient Deep Model

A Novel Face Super Resolution Approach for Noisy Images Using Contour Feature and Standard Deviation Prior

Efficient Face Super-Resolution via Wavelet-based Feature Enhancement Network

Multi-Scale Feature Fusion and Structure-Preserving Network for Face Super-Resolution

Depth Map Denoising Network and Lightweight Fusion Network for Enhanced 3D Face Recognition

A Face Structure Attention Network for Face Super-Resolution

UFSRNet: U-shaped face super-resolution reconstruction network based on wavelet transform

Deep Illumination-Enhanced Face Super-Resolution Network for Low-Light Images