Deep Fractal Residual Network for Fast and Accurate Single Image Super Resolution

Yanghao Zhou,Jianfeng Dong,Yubin Yang
DOI: https://doi.org/10.1016/j.neucom.2019.09.093
IF: 6
2019-01-01
Neurocomputing
Abstract:Recently, deep convolutional neural networks (CNNs) have achieved excellent performance improvement in Single Image Super-Resolution (SISR) tasks. However, it is still difficult for most of the existing CNN-based models to learn and make full use of adequate hierarchical features, which is crucial to ideally recover both high-frequency and low-frequency information. Generally, many networks tend to incorporate numerous parameters aiming to improve their learning capability, which demands more storage and is less applicable to mobile systems. To address this issue, we propose a novel method for SISR by using a deep fractal residual network (DFRN) composed of a series of fractal blocks containing multiple paths for feature extraction. The fractal blocks learn and combine different hierarchical features to generate finer features favoring the reconstruction of high resolution (HR) images. Moreover, we integrate both local and global residual learning to preserve the low-level features and decrease the difficulty of training. Finally, we propose a weight-sharing version with fewer parameters to reduce the space complexity while keeping comparable performance. Experimental results demonstrate that DFRN has the capability of learning different hierarchical features and outperforms other state-of-the-art methods for SISR by reconstructing low resolution (LR) images into the HR images quickly and accurately.
What problem does this paper attempt to address?