Prior-guided Dense Up-Down Sampling Network for Face Super-Resolution and Recognition

Simiao Wang,Yunan Liu,Chunpeng Wang,Mingyu Lu
DOI: https://doi.org/10.1117/12.2680073
2022-01-01
Abstract:Identifying low-resolution (LR) face images in the wild is still an open and challenging task, (1)as discriminative feature is hard to learn from LR image with blurry appearance. To address this problem, many face super-resolution (SR) methods have been proposed to reconstruct high-resolution (HR) face images from the observed LR images. However, most of existing methods have two drawbacks: they tend to generate over-smoothed results, and they largely ignore to recover the facial identity information. In this paper, we propose a new multi-task framework for very small face image SR and recognition. First, we propose the Dense Up-down Sampling Unit (DUSU), which is able to effectively represent the nonlinear LR-to-HR mapping via an error-correcting feedback mechanism. Secondly, we introduce an effective and robust facial prior knowledge, the high frequency sub-bands of Non-Subsampled Contourlet Transform (NSCT), to enhance the texture details of super-resolved images. Third, we introduce an evaluation network with perceptual loss to recover the identity information of reconstructed face images. Extensive experiments demonstrate that our method not only achieves more appealing results than the state-of-the-art methods in terms of traditional SR metrics, but also significantly improve recognition accuracy of very small faces in the wild.
What problem does this paper attempt to address?