RAN: Resolution-Aware Network for Image Super-resolution

Yifan Wang,Lijun Wang,Hongyu Wang,Peihua Li
DOI: https://doi.org/10.1109/tcsvt.2018.2839879
IF: 5.859
2018-01-01
IEEE Transactions on Circuits and Systems for Video Technology
Abstract:In existing deep network based image superresolution (SR) methods, each network is only trained for a fixed upscaling factor and can hardly generalize to unseen factors at test time, which is non-scalable in real applications. To mitigate this issue, this paper proposes a resolution-aware network (RAN) for simultaneous SR of multiple factors. The key insight is that SR of multiple factors are essentially different but also share common operations. To attain stronger generalization across factors, we design an upsampling network (U-Net) consisting of several submodules, where each sub-module implements an intermediate step of the overall image SR and can be shared by SR of different factors. A decision network (D-Net) is further adopted to identify the quality of the input low-resolution (LR) image and adaptively select suitable sub-modules to perform SR. U-Net and D-Net together constitute the proposed RAN model, and are jointly trained using a new hierarchical loss function on SR tasks of multiple factors. Experimental evaluations demonstrate that the proposed RAN compares favorably against state-of-the-art methods and its performance can well generalize across different upscaling factors.
What problem does this paper attempt to address?