DGRN: Image Super-Resolution with Dual Gradient Regression Guidance

HeLiang Yang,YongJun Zhang,ZhongWei Cui,YuJie Xu,YiTong Yang
DOI: https://doi.org/10.1016/j.cag.2022.12.005
IF: 1.821
2022-01-01
Computers & Graphics
Abstract:In single image super-resolution (SISR), deep neural networks learn mainly nonlinear functions to obtain promising high-resolution (HR) images. However, there are usually two undesired limitations to recovered images of existing SR methods. First, since this task is typically an ill-posed problem, recovering the structural information for the SR process is usually sharp edges but distorted. Second, since this task generally has an extremely large space for the mapping function, learning this mapping from low-resolution (LR) to HR images is typically difficult. For the most part, SR models usually suffer from the lack of structural information for the objects in images and poor performance. To address the above issues, we propose a dual gradient regression scheme in the first stage of the network to recover the structure information of objects in images and the corresponding loss function to learn the difference between structural maps. In the second stage of the network, we restore HR gradient maps by the first stage to provide additional structural information for the second stage, further constraining the structure of the SR image and reducing the space of the possible functions. Extensive experiments demonstrate our results outperform the state-of-the-art SR methods in the SSIM, and achieve better visual effects than the state-of-the-art SR methods.
What problem does this paper attempt to address?