Abstract:Whether conventional machine learning-based or current deep neural networks-based single image super-resolution (SISR) methods, they are generally trained and validated on synthetic datasets, in which low-resolution (LR) inputs are artificially produced by degrading high-resolution (HR) images based on a hand-crafted degradation model (e.g., bicubic downsampling). One of the main reasons for this is that it is challenging to build a realistic dataset composed of real-world LR–HR image pairs. However, a domain gap exists between synthetic and real-world data because the degradations in real scenarios are more complicated, limiting the performance in practical applications of SISR models trained with synthetic data. To address these problems, we propose a Self-supervised Cycle-consistent Learning-based Scale-Arbitrary Super-Resolution framework (SCL-SASR) for real-world images. Inspired by the Maximum a Posteriori estimation, our SCL-SASR consists of a Scale-Arbitrary Super-Resolution Network (SASRN) and an inverse Scale-Arbitrary Resolution-Degradation Network (SARDN). SARDN and SASRN restrain each other with the bidirectional cycle consistency constraints as well as image priors, making SASRN adapt to the image-specific degradation well. Meanwhile, considering the lack of targeted training images and the complexity of realistic degradations, SCL-SASR is designed to be online optimized solely with the LR input prior to the SR reconstruction. Benefitting from the flexible architecture and the self-supervised learning manner, SCL-SASR can easily super-resolve new images with arbitrary integer or non-integer scaling factors. Experiments on real-world images demonstrate the high flexibility and good applicability of SCL-SASR, which achieves better reconstruction performance than state-of-the-art self-supervised learning-based SISR methods as well as several external dataset-trained SISR models.

Exploiting Self-Supervised Constraints in Image Super-Resolution

SGCRSR: Sequential Gradient Constrained Regression for Single Image Super-Resolution

Image Super-Resolution Based on Additional Self-Loop Supervision

Single Image Superresolution Using Maximizing Self-Similarity Prior

Single-Image Superresolution Based on Local Regression and Nonlocal Self-Similarity

Image Super-Resolution Using Multi-Layer Support Vector Regression

Multiscale Self-Similarity And Sparse Representation Based Single Image Super-Resolution

Toward Real-World Super Resolution With Adaptive Self-Similarity Mining

Single Image Super-Resolution by Combining Self-Learning and Example-Based Learning Methods

Self-supervised Cycle-Consistent Learning for Scale-Arbitrary Real-World Single Image Super-Resolution

SCCADC-SR: a Real Image Super-Resolution Based on Self-Calibration Convolution and Adaptive Dense Connection

Single Image Super-Resolution with Multiscale Similarity Learning.

Image Super-resolution Based on Sparse Representation With Joint Constraints

Single Remote Sensing Image Super-Resolution with an Adaptive Joint Constraint Model

Single Image Super-Resolution Via Adaptive Sparse Representation and Low-Rank Constraint.

Self-adaptive Blind Super-Resolution Image Reconstruction

Unsupervised Real-World Image Super-Resolution via Dual Synthetic-to-Realistic and Realistic-to-Synthetic Translations

Image super-resolution via adaptive filtering and regularization

Image Super-Resolution Framework with Multi-Channel Constraints.

Learning Recurrent Residual Regressors for Single Image Super-Resolution

Subspace Constraint for Single Image Super-Resolution