Abstract:Whether conventional machine learning-based or current deep neural networks-based single image super-resolution (SISR) methods, they are generally trained and validated on synthetic datasets, in which low-resolution (LR) inputs are artificially produced by degrading high-resolution (HR) images based on a hand-crafted degradation model (e.g., bicubic downsampling). One of the main reasons for this is that it is challenging to build a realistic dataset composed of real-world LR–HR image pairs. However, a domain gap exists between synthetic and real-world data because the degradations in real scenarios are more complicated, limiting the performance in practical applications of SISR models trained with synthetic data. To address these problems, we propose a Self-supervised Cycle-consistent Learning-based Scale-Arbitrary Super-Resolution framework (SCL-SASR) for real-world images. Inspired by the Maximum a Posteriori estimation, our SCL-SASR consists of a Scale-Arbitrary Super-Resolution Network (SASRN) and an inverse Scale-Arbitrary Resolution-Degradation Network (SARDN). SARDN and SASRN restrain each other with the bidirectional cycle consistency constraints as well as image priors, making SASRN adapt to the image-specific degradation well. Meanwhile, considering the lack of targeted training images and the complexity of realistic degradations, SCL-SASR is designed to be online optimized solely with the LR input prior to the SR reconstruction. Benefitting from the flexible architecture and the self-supervised learning manner, SCL-SASR can easily super-resolve new images with arbitrary integer or non-integer scaling factors. Experiments on real-world images demonstrate the high flexibility and good applicability of SCL-SASR, which achieves better reconstruction performance than state-of-the-art self-supervised learning-based SISR methods as well as several external dataset-trained SISR models.

Joint Generative Learning and Super-Resolution For Real-World Camera-Screen Degradation

Joint Generative Learning and Super-Resolution for Real-World Camera-Screen Degradation

Single-Image Super Resolution of Remote Sensing Images with Real-World Degradation Modeling

Learning Structral Coherence Via Generative Adversarial Network for Single Image Super-Resolution

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Dynamic Degradation Learning for Real-World Image Super-Resolution

Adaptive Loss Function for Super Resolution Neural Networks Using Convex Optimization Techniques

Real-World Image Super-Resolution Via Kernel Augmentation and Stochastic Variation.

Frequency-Aware Physics-Inspired Degradation Model for Real-World Image Super-Resolution

An Efficient Dual-reference Training Data Acquisition Method for CNN Image Super-Resolution

Learning to Zoom-in Via Learning to Zoom-out: Real-world Super-resolution by Generating and Adapting Degradation

GDSSR: Toward Real-World Ultra-High-Resolution Image Super-Resolution

Self-supervised Cycle-Consistent Learning for Scale-Arbitrary Real-World Single Image Super-Resolution

A practical super-resolution method for multi-degradation remote sensing images with deep convolutional neural networks

Hierarchical Generative Adversarial Networks for Single Image Super-Resolution

Data Acquisition and Preparation for Dual-reference Deep Learning of Image Super-Resolution

Unsupervised Real-World Image Super-Resolution via Dual Synthetic-to-Realistic and Realistic-to-Synthetic Translations

Sharp And Real Image Super-Resolution Using Generative Adversarial Network

Deep Super-Resolution Network for Single Image Super-Resolution with Realistic Degradations

Learning a Single Convolutional Super-Resolution Network for Multiple Degradations

A Data Enhancement Method toward Real-World Single Image Super-Resolution