Abstract:Example learning-based image super-resolution (SR) is recognized as an effective way to produce a high-resolution (HR) image with the help of an external training set. The effectiveness of learning-based SR methods, however, depends highly upon the consistency between the supporting training set and low-resolution (LR) images to be handled. To reduce the adverse effect brought by incompatible high-frequency details in the training set, we propose a single image SR approach by learning multiscale self-similarities from an LR image itself. The proposed SR approach is based upon an observation that small patches in natural images tend to redundantly repeat themselves many times both within the same scale and across different scales. To synthesize the missing details, we establish the HR-LR patch pairs using the initial LR input and its down-sampled version to capture the similarities across different scales and utilize the neighbor embedding algorithm to estimate the relationship between the LR and HR image pairs. To fully exploit the similarities across various scales inside the input LR image, we accumulate the previous resultant images as training examples for the subsequent reconstruction processes and adopt a gradual magnification scheme to upscale the LR input to the desired size step by step. In addition, to preserve sharper edges and suppress aliasing artifacts, we further apply the nonlocal means method to learn the similarity within the same scale and formulate a nonlocal prior regularization term to well pose SR estimation under a reconstruction-based SR framework. Experimental results demonstrate that the proposed method can produce compelling SR recovery both quantitatively and perceptually in comparison with other state-of-the-art baselines.

Single image super-resolution via self-similarity and low-rank matrix recovery

Single Image Super-Resolution with One-Pass Algorithm and Local Neighbor Regression

A Single-Image Super-Resolution Method Via Low-Rank Matrix Recovery And Nonlinear Mappings

Single Image Superresolution Using Maximizing Self-Similarity Prior

Single Image Super-Resolution Via Adaptive Transform-Based Nonlocal Self-Similarity Modeling and Learning-Based Gradient Regularization

Sparse Representation Based Single Image Super-Resolution with Low-Rank Constraint and Nonlocal Self-Similarity

Low-rank Sparse Representation for Single Image Super-Resolution Via Self-Similarity Learning

Single Image Super Resolution Using Local Smoothness and Nonlocal Self-Similarity Priors

Single Image Super-Resolution Based on Nonlocal Sparse and Low-Rank Regularization.

Single Image Super-Resolution Based on Nonlocal Similarity and Sparse Representation

Multiscale Self-Similarity And Sparse Representation Based Single Image Super-Resolution

Single Image Super Resolution Based on Multi-Scale Structural Self Similarity and Neighborhood Regression

Single image super-resolution based on convolutional neural networks

Single Image Super-Resolution with Non-Local Balanced Low-Rank Matrix Restoration

Single Image Super-Resolution with Multiscale Similarity Learning.

Fast and Accurate Single Image Super-Resolution Via an Energy-Aware Improved Deep Residual Network.

Single Image Super-Resolution by Combining Self-Learning and Example-Based Learning Methods

Self-Similarity Superresolution for Resource-Constrained Image Sensor Node in Wireless Sensor Networks

Single-Image Superresolution Based on Local Regression and Nonlocal Self-Similarity

Compressive Sampling based Single-Image Super-resolution Reconstruction by dual-sparsity and Non-local Similarity Regularizer

Single Image Super-Resolution Via Adaptive Sparse Representation and Low-Rank Constraint.