Abstract:Learning based super-resolution (SR) methods, which predict the high-resolution pixel values but not directly provide an estimation of uncertainty, are typically non-probabilistic and have limited generalization ability. Gaussian processes can provide a framework for deriving regression techniques with explicit uncertainty models, but Gaussian Process Regression (GPR) has a significant drawback in being time consuming. The computational complexity of GPR is cubic in the number of training examples, which is prohibitively expensive for a large-scale training set. In this article, we have proposed learning local GPR for image SR. Two algorithms are developed to support local GPR for super resolution. A data-driven GPR based super-resolution algorithm is first developed to learn a local GPR model for every LR patch on an input oriented training dataset with moderate size. In order to further improve the running speed, a prototype based GPR algorithm is developed for super resolution. The proposed algorithm is about one-order faster than the data-driven GPR solution because it makes models for the prototypes of image patches rather than for each image patch. Thus, the local regression efforts are greatly reduced to just finding the nearest prototype for each LR image patch and applying its corresponding pre-computed projective matrix for super-resolution prediction. Our algorithms have greater robustness and usability as they provide a formularized way to automatically learn the hyper-parameters introduced for optimizing the covariance function, while most of the state-of-the-art super-resolution methods could only utilize these parameters in a cross-verification way. Moreover, our algorithms offer confidence values at the test points which benefit the pixels' post-processing. Our algorithms are evaluated on popular datasets that are widely used in the super-resolution literature, and the experimental results have demonstrated that the efficiency and effectiveness of our proposed algorithms are comparative with several state-of-the-arts super-resolution methods.

Nonlocal Similarity Modeling and Deep CNN Gradient Prior for Super Resolution

Adaptive Loss Function for Super Resolution Neural Networks Using Convex Optimization Techniques

A New Convolutional Neural Network for Super-Resolution by Global and Local Residual

Single Image Super-Resolution Via Locally Regularized Anchored Neighborhood Regression and Nonlocal Means.

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Non-Local Similarity-Based Attentive Graph Convolution Network for Remote Sensing Image Super-Resolution

Sub-Pixel Convolutional Neural Network for Image Super-Resolution Reconstruction

End-to-End Image Super-Resolution via Deep and Shallow Convolutional Networks

A Novel Convolutional Neural Network Architecture for Image Super-Resolution Based on Channels Combination

Video Super-Resolution Reconstruction Based on Deep Convolutional Neural Network and Spatio-Temporal Similarity

Learning-based Super-Resolution Method with a Combining of Both Global and Local Constraints

Image Super-Resolution Using Deep Convolutional Networks

Super-Resolution for Noisy Images Via Deep Convolutional Neural Network

Accurate and Efficient Image Super-Resolution via Global-Local Adjusting Dense Network

Local Spatial Information for Image Super-Resolution.

Learning Local Gaussian Process Regression for Image Super-Resolution.

SINGLE IMAGE SUPER-RESOLUTION USING A NON-LOCAL 3D CONVOLUTIONAL NEURAL NETWORK

Relation-consistency Graph Convolutional Network for Image Super-Resolution

A Single Image Super-Resolution Algorithm Based on Dense Residual Convolutional Network

Single Image Super-Resolution with Non-Local Means and Steering Kernel Regression

Single-image Super-Resolution Via Joint Statistic Models-Guided Deep Auto-Encoder Network