From Low to High: Cascade Network for Restoring Low-Resolution Face Image Via Extracting and Transforming Edge Feature

Xiaoyuan Yu,Wei Xie,Langwen Zhang
DOI: https://doi.org/10.1007/s11042-022-13693-3
IF: 2.577
2022-01-01
Multimedia Tools and Applications
Abstract:The super-resolution task about the single facial image is the specific task in single image super-resolution (SISR), which has attracted much attention from researchers. Various facial SISR methods based on deep learning have achieved excellent performance. Unfortunately, most existing methods perform poorly for generating the SR image with large upsampling factors when the input image has a lower resolution. To break the above limitations, we propose a two-stage cascade network (TSCnet) under an end-to-end manner to reconstruct SR face image with large upsampling factors. The coarse SR facial image with middle magnification is generated at the first stage while the final SR facial image is obtained at the second stage by concatenating the coarse SR image and the upsampling result of the input image. In particular, inspired by the physical model of image restoration, the blurry kernel predicted (BKP) module within the improved residual block (ImRB) is designed to transform useful intermediate features during each stage by combining the edge feature extracted from the coarse face image. Furthermore, we also design a self-attention U-net (SAUnet) to extract the correct edge feature of the coarse face image. Compared with the state-of-the-art methods, the proposed method improves the visual value by about 1.4% LPIPS on the test data. Expanded experiments demonstrate that the proposed method performs well in quantitative and qualitative evaluations when generating the facial SR image with size 256 × 256 from the LR image with size 16 × 16. The code is released in https://github.com/Andyyu001/MTAP_SR .
What problem does this paper attempt to address?