Abstract:Recent advances in the design of convolutional neural network (CNN) have yielded significant improvements in the performance of image super-resolution (SR). The boost in performance can be attributed to the presence of residual or dense connections within the intermediate layers of these networks. The efficient combination of such connections can reduce the number of parameters drastically while maintaining the restoration quality. In this paper, we propose a scale recurrent SR architecture built upon units containing series of dense connections within a residual block (Residual Dense Blocks (RDBs)) that allow extraction of abundant local features from the image. Our scale recurrent design delivers competitive performance for higher scale factors while being parametrically more efficient as compared to current state-of-the-art approaches. To further improve the performance of our network, we employ multiple residual connections in intermediate layers (referred to as Multi-Residual Dense Blocks), which improves gradient propagation in existing layers. Recent works have discovered that conventional loss functions can guide a network to produce results which have high PSNRs but are perceptually inferior. We mitigate this issue by utilizing a Generative Adversarial Network (GAN) based framework and deep feature (VGG) losses to train our network. We experimentally demonstrate that different weighted combinations of the VGG loss and the adversarial loss enable our network outputs to traverse along the perception-distortion curve. The proposed networks perform favorably against existing methods, both perceptually and objectively (PSNR-based) with fewer parameters.

Multi-Scale Gradient Image Super-Resolution for Preserving SIFT Key Points in Low-Resolution Images

Gradient Image Super-Resolution For Low-Resolution Image Recognition

An Efficient Multi-scale Method for Single Image Super Resolution.

Remote Sensing Single-Image Resolution Improvement Using A Deep Gradient-Aware Network with Image-Specific Enhancement

A Comprehensive Review of Deep Learning-Based Single Image Super-Resolution

Gradient-Guided and Multi-Scale Feature Network for Image Super-Resolution

Multi-Scale Deep Neural Networks for Real Image Super-Resolution

Remote Sensing Image Super-Resolution Using Second-Order Multi-Scale Networks

Multi-Scale Residual Network For Image Super-Resolution

Single image super-resolution via deep progressive multi-scale fusion networks

Deep Networks for Image and Video Super-Resolution

Image Super-Resolution Via a Novel Cascaded Convolutional Neural Network Framework.

Image Superresolution using Scale-Recurrent Dense Network

Multi-Scale Information Distillation Network for Efficient Image Super-Resolution

Multi-Frame Super Resolution With Deep Residual Learning On Flow Registered Non-Integer Pixel Images

Gradient Information Distillation Network for Real-Time Single-Image Super-Resolution.

A New Super Resolution Framework Based on Multi-Task Learning for Remote Sensing Images

DGRN: Image Super-Resolution with Dual Gradient Regression Guidance

Gated Multiple Feedback Network for Image Super-Resolution.

Image Super-Resolution Using Deep Convolutional Networks

Multi-scale Receptive Field Fusion Network for Lightweight Image Super-Resolution