Abstract:One impressive advantage of convolutional neural networks (CNNs) is their ability to automatically learn feature representation from raw pixels, eliminating the need for hand-designed procedures. However, recent methods for single image super-resolution (SR) fail to maintain this advantage. They utilize CNNs in two decoupled steps, i.e., first upsampling the low resolution (LR) image to the high resolution (HR) size with hand-designed techniques (e.g., bicubic interpolation), and then applying CNNs on the upsampled LR image to reconstruct HR results. In this paper, we seek an alternative and propose a new image SR method, which jointly learns the feature extraction, upsampling and HR reconstruction modules, yielding a completely end-to-end trainable deep CNN. As opposed to existing approaches, the proposed method conducts upsampling in the latent feature space with filters that are optimized for the task of image SR. In addition, the HR reconstruction is performed in a multi-scale manner to simultaneously incorporate both short- and long-range contextual information, ensuring more accurate restoration of HR images. To facilitate network training, a new training approach is designed, which jointly trains the proposed deep network with a relatively shallow network, leading to faster convergence and more superior performance. The proposed method is extensively evaluated on widely adopted data sets and improves the performance of state-of-the-art methods with a considerable margin. Moreover, in-depth ablation studies are conducted to verify the contribution of different network designs to image SR, providing additional insights for future research.

Two-Stage Convolutional Network for Image Super-Resolution

Hyperspectral Image Super-Resolution Via Convolutional Neural Network

A Two-Stage Attentive Network for Single Image Super-Resolution

A Dual CNN for Image Super-Resolution

A Two-Stage Convolutional Neural Network for Joint Demosaicking and Super-Resolution

A New Convolutional Neural Network for Super-Resolution by Global and Local Residual

A Single Image Super-Resolution Algorithm Based on Dense Residual Convolutional Network

End-to-End Image Super-Resolution via Deep and Shallow Convolutional Networks

Remote Sensing Images Super-Resolution with Deep Convolution Networks

Image Super-Resolution Using Deep Convolutional Networks

Sub-Pixel Convolutional Neural Network for Image Super-Resolution Reconstruction

A Single Super-Resolution Method Via Deep Cascade Network

Coarse-to-Fine CNN for Image Super-Resolution

Large Factor Image Super-Resolution with Cascaded Convolutional Neural Networks.

Single Image Super-Resolution Via Cascaded Multi-Scale Cross Network.

Single Image Super-Resolution Using Dual-Branch Convolutional Neural Network.

Compressed Multi-Scale Feature Fusion Network for Single Image Super-Resolution.

A Novel Convolutional Neural Network Architecture for Image Super-Resolution Based on Channels Combination

Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution

Multi-Scale Residual Network For Image Super-Resolution

A Novel Multiconnected Convolutional Network for Super-Resolution.