Abstract:Example learning-based image super-resolution (SR) is recognized as an effective way to produce a high-resolution (HR) image with the help of an external training set. The effectiveness of learning-based SR methods, however, depends highly upon the consistency between the supporting training set and low-resolution (LR) images to be handled. To reduce the adverse effect brought by incompatible high-frequency details in the training set, we propose a single image SR approach by learning multiscale self-similarities from an LR image itself. The proposed SR approach is based upon an observation that small patches in natural images tend to redundantly repeat themselves many times both within the same scale and across different scales. To synthesize the missing details, we establish the HR-LR patch pairs using the initial LR input and its down-sampled version to capture the similarities across different scales and utilize the neighbor embedding algorithm to estimate the relationship between the LR and HR image pairs. To fully exploit the similarities across various scales inside the input LR image, we accumulate the previous resultant images as training examples for the subsequent reconstruction processes and adopt a gradual magnification scheme to upscale the LR input to the desired size step by step. In addition, to preserve sharper edges and suppress aliasing artifacts, we further apply the nonlocal means method to learn the similarity within the same scale and formulate a nonlocal prior regularization term to well pose SR estimation under a reconstruction-based SR framework. Experimental results demonstrate that the proposed method can produce compelling SR recovery both quantitatively and perceptually in comparison with other state-of-the-art baselines.

Multi-fidelity and learning-regularization for single image super resolution

Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Boosting Single Image Super-Resolution Learnt from Implicit Multi-Image Prior.

Single-image Super-Resolution Via Selective Multi-Scale Network

Multilevel Residual Learning for Single Image Super Resolution.

Fast and Accurate Single Image Super-Resolution Via an Energy-Aware Improved Deep Residual Network.

Single Image Super-Resolution with Multiscale Similarity Learning.

A Structural Low Rank Regularization Method for Single Image Super-Resolution

A flow-based multi-scale learning network for single image stochastic super-resolution

Hybrid Pixel-Wise Registration Learning for Robust Fusion-Based Hyperspectral Image Super-Resolution

Hierarchical Similarity Learning for Aliasing Suppression Image Super-Resolution

Multi-Level Feature Fusion Mechanism for Single Image Super-Resolution

MRFN: Multi-Receptive-Field Network for Fast and Accurate Single Image Super-Resolution

A Unified Learning Framework for Single Image Super-Resolution

Adjustable Super-Resolution Network Via Deep Supervised Learning and Progressive Self-Distillation

A Data Enhancement Method toward Real-World Single Image Super-Resolution

A Fast And Accurate Super-Resolution Network Using Progressive Residual Learning

Learning from Multi-Perception Features for Real-Word Image Super-resolution

Iterative Network for Image Super-Resolution

Joint Learning of Super-Resolution and Perceptual Image Enhancement for Single Image.

A Multi-Frame Image Super-Resolution Method.