Abstract:Learning based super-resolution (SR) methods, which predict the high-resolution pixel values but not directly provide an estimation of uncertainty, are typically non-probabilistic and have limited generalization ability. Gaussian processes can provide a framework for deriving regression techniques with explicit uncertainty models, but Gaussian Process Regression (GPR) has a significant drawback in being time consuming. The computational complexity of GPR is cubic in the number of training examples, which is prohibitively expensive for a large-scale training set. In this article, we have proposed learning local GPR for image SR. Two algorithms are developed to support local GPR for super resolution. A data-driven GPR based super-resolution algorithm is first developed to learn a local GPR model for every LR patch on an input oriented training dataset with moderate size. In order to further improve the running speed, a prototype based GPR algorithm is developed for super resolution. The proposed algorithm is about one-order faster than the data-driven GPR solution because it makes models for the prototypes of image patches rather than for each image patch. Thus, the local regression efforts are greatly reduced to just finding the nearest prototype for each LR image patch and applying its corresponding pre-computed projective matrix for super-resolution prediction. Our algorithms have greater robustness and usability as they provide a formularized way to automatically learn the hyper-parameters introduced for optimizing the covariance function, while most of the state-of-the-art super-resolution methods could only utilize these parameters in a cross-verification way. Moreover, our algorithms offer confidence values at the test points which benefit the pixels' post-processing. Our algorithms are evaluated on popular datasets that are widely used in the super-resolution literature, and the experimental results have demonstrated that the efficiency and effectiveness of our proposed algorithms are comparative with several state-of-the-arts super-resolution methods.

Variational probabilistic generative framework for single image super-resolution.

Generative Bayesian Image Super Resolution with Natural Image Prior.

CDPMSR: Conditional Diffusion Probabilistic Models for Single Image Super-Resolution

Learning Structral Coherence Via Generative Adversarial Network for Single Image Super-Resolution

Generative Adversarial Network-based Image Super-Resolution with a Novel Quality Loss

Learning Spectral and Spatial Features Based on Generative Adversarial Network for Hyperspectral Image Super-Resolution

End-to-End Image Super-Resolution Via Generative Adversarial Network

Variational Bayesian super-resolution based on composite prior modeling

Image Super-Resolution Using Non-Local Gaussian Process Regression

Multitemporal Hyperspectral Image Super-Resolution Through 3D Generative Adversarial Network

Learning Local Gaussian Process Regression for Image Super-Resolution.

A Variational Bayesian Superresolution Approach Using Adaptive Image Prior Model

Image Super Resolution Using Gaussian Process Regression with Patch Clustering

Hyperspectral Imagery Spatial Super-Resolution Using Generative Adversarial Network.

Image Super-Resolution Using a Improved Generative Adversarial Network

Single Image Super-Resolution Using Gaussian Process Regression With Dictionary-Based Sampling and Student- ${t}$ Likelihood.

Weighted Gaussian Process Regression for Single Image Super-resolution Based on Randomized Sample Clustering and Augmentation

Image Super-Resolution via Sparse Bayesian Modeling of Natural Images

Multi-image Blind Super-Resolution in Variational Bayesian Framework

A Positive-Unlabeled Generative Adversarial Network for Super-Resolution Image Reconstruction Using a Charbonnier Loss

Variational Bayesian Framework for Advanced Image Generation with Domain-Related Variables