Abstract:Example learning-based image super-resolution (SR) is recognized as an effective way to produce a high-resolution (HR) image with the help of an external training set. The effectiveness of learning-based SR methods, however, depends highly upon the consistency between the supporting training set and low-resolution (LR) images to be handled. To reduce the adverse effect brought by incompatible high-frequency details in the training set, we propose a single image SR approach by learning multiscale self-similarities from an LR image itself. The proposed SR approach is based upon an observation that small patches in natural images tend to redundantly repeat themselves many times both within the same scale and across different scales. To synthesize the missing details, we establish the HR-LR patch pairs using the initial LR input and its down-sampled version to capture the similarities across different scales and utilize the neighbor embedding algorithm to estimate the relationship between the LR and HR image pairs. To fully exploit the similarities across various scales inside the input LR image, we accumulate the previous resultant images as training examples for the subsequent reconstruction processes and adopt a gradual magnification scheme to upscale the LR input to the desired size step by step. In addition, to preserve sharper edges and suppress aliasing artifacts, we further apply the nonlocal means method to learn the similarity within the same scale and formulate a nonlocal prior regularization term to well pose SR estimation under a reconstruction-based SR framework. Experimental results demonstrate that the proposed method can produce compelling SR recovery both quantitatively and perceptually in comparison with other state-of-the-art baselines.

Image Super-Resolution Framework with Multi-Channel Constraints.

Multi-frame Image Super Resolution with Natural Image Prior

Multispectral Image Super-Resolution Via RGB Image Fusion and Radiometric Calibration

A Multi-Frame Image Super-Resolution Method.

A multi-frame adaptive super-resolution method using double channel and regional pixel information

A Hybrid Multi-Frame Super-Resolution Algorithm Using Multi-Channel Memristive Pulse Coupled Neural Network and Sparse Coding

Multi-Frame Image Super-Resolution Based on Regularization Scheme

A Single-Image Super-Resolution Method Based on Progressive-Iterative Approximation

Single Remote Sensing Image Super-Resolution with an Adaptive Joint Constraint Model

Frequency Domain Based Super-Resolution Method for Mixed-Resolution Multi-View Images

Image Super-resolution Based on Sparse Representation With Joint Constraints

Single Image Super-Resolution Based on Nonlocal Similarity and Sparse Representation

Multi-frame image super-resolution reconstruction using sparse co-occurrence prior and sub-pixel registration.

A Unified Learning Framework for Single Image Super-Resolution

Efficient Image Super-Resolution Integration

Multi-frame Super Resolution Using Refined Exploration of Extensive Self-examples.

Single Image Super-Resolution with Multiscale Similarity Learning.

Improved Super-Resolution Reconstruction From Video

Fast Convergence Strategy for Multi-Image Superresolution via Adaptive Line Search.

An Adaptive Method for Simultaneous Image Super-Resolution and Motion Estimation Based on Nonlinear Least Square

Image super-resolution via adaptive filtering and regularization