Abstract: Current learning-based single image super-resolution (SISR) algorithms underperform on real data due to the deviation in the assumed degrada-tion process from that in the real-world scenario. Conventional degradation processes consider applying blur, noise, and downsampling (typicallybicubic downsampling) on high-resolution (HR) images to synthesize low-resolution (LR) counterparts. However, few works on degradation modelling have taken the physical aspects of the optical imaging system intoconsideration. In this paper, we analyze the imaging system optically andexploit the characteristics of the real-world LR-HR pairs in the spatial frequency domain. We formulate a real-world physics-inspired degradationmodel by considering bothopticsandsensordegradation; The physical degradation of an imaging system is modelled as a low-pass filter, whose cut-off frequency is dictated by the object distance, the focal length of thelens, and the pixel size of the image sensor. In particular, we propose to use a convolutional neural network (CNN) to learn the cutoff frequency of real-world degradation process. The learned network is then applied to synthesize LR images from unpaired HR images. The synthetic HR-LR image pairs are later used to train an SISR network. We evaluatethe effectiveness and generalization capability of the proposed degradation model on real-world images captured by different imaging systems. Experimental results showcase that the SISR network trained by using our synthetic data performs favorably against the network using the traditional degradation model. Moreover, our results are comparable to that obtained by the same network trained by using real-world LR-HR pairs, which are challenging to obtain in real scenes.

Learning the Frequency Domain Aliasing for Real-World Super-Resolution

Real-world super-resolution based on iterative frequency domain degradation model

SelFSR: Self-Conditioned Face Super-Resolution in the Wild Via Flow Field Degradation Network

SelFSR: Self-Conditioned Face Super-Resolution in the Wild via Flow Field Degradation Network

Frequency-Aware Physics-Inspired Degradation Model for Real-World Image Super-Resolution

Frequency-Aware Degradation Modeling for Real-World Thermal Image Super-Resolution

Real-World Super-Resolution Via Kernel Estimation and Noise Injection

Frequency Consistent Adaptation for Real World Super Resolution

Learning to Zoom-in Via Learning to Zoom-out: Real-world Super-resolution by Generating and Adapting Degradation

Super-Resolution Degradation Model: Converting High-Resolution Datasets to Optical Zoom Datasets

Frequency Separation for Real-World Super-Resolution.

Hierarchical Similarity Learning for Aliasing Suppression Image Super-Resolution

An Image Arbitrary-Scale Super-Resolution Network Using Frequency-domain Information

Super-resolution from unregistered aliased images with unknown scalings and shifts

Dynamic Degradation Learning for Real-World Image Super-Resolution

Learning Degradation-Robust Spatiotemporal Frequency-Transformer for Video Super-Resolution

A Data Enhancement Method toward Real-World Single Image Super-Resolution

Antialiased Super-Resolution with Parallel High-Frequency Synthesis

Single-Image Super Resolution of Remote Sensing Images with Real-World Degradation Modeling

Delving Deeper into Anti-Aliasing in ConvNets

Learning Spatiotemporal Frequency-Transformer for Low-Quality Video Super-Resolution