Abstract:For deep learning methods of image superresolution, the most critical issue is whether the paired low and high resolution images for training accurately reflect the sampling process of real cameras. Low and high resolution (LR∼HR) image pairs synthesized by existing degradation models (e.g., bicubic downsampling) deviate from those in reality; thus the superresolution CNN trained by these synthesized LR∼HR image pairs does not perform well when being applied to real images. In this paper, we propose a novel method to capture a large set of realistic LR∼HR image pairs using real cameras. The data acquisition is carried out under controllable lab conditions with minimum human intervention and at high throughput (about 500 image pairs per hour). The high level of automation makes it easy to produce a set of real LR∼HR training image pairs for each camera. Our innovation is to shoot images displayed on an ultra-high quality screen at different resolutions. There are three distinctive advantages of our method for image superresolution. First, as the LR and HR images are taken of a 3D planar surface (the screen) the registration problem fits exactly to a homography model and we can display specially designed markers on the image to improve the registration precision. Second, the displayed digital image file can be exploited as a reference to optimize the high frequency content of the restored image. Third, this high-efficiency data collection method makes it possible to collect a customized dataset for each camera sensor, for which one can train a specific model for the intended camera sensor. Experimental results show that training a superresolution CNN by our LR∼HR dataset has superior restoration performance than training it by existing datasets on real world images at the inference stage.

A Capture to Registration Framework for Realistic Image Super-Resolution in the Industry Environment

Multispectral Image Super-Resolution Via RGB Image Fusion and Radiometric Calibration

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Unveiling Hidden Details: A RAW Data-Enhanced Paradigm for Real-World Super-Resolution

Real-world single image super-resolution: A brief review

Single Image Super-Resolution Quality Assessment: A Real-World Dataset, Subjective Studies, and an Objective Metric

Real-infraredSR: real-world infrared image super-resolution via thermal imager

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Super-Resolution Perception for Industrial Sensor Data

NTIRE 2019 Challenge on Real Image Super-Resolution: Methods and Results

Data Acquisition and Preparation for Dual-reference Deep Learning of Image Super-Resolution

An Efficient Dual-reference Training Data Acquisition Method for CNN Image Super-Resolution

A Closed-Loop Network for Single Infrared Remote Sensing Image Super-Resolution in Real World

A Systematic Survey of Deep Learning-based Single-Image Super-Resolution

Towards Real-World Burst Image Super-Resolution: Benchmark and Method

Super-resolving Real-world Image Illumination Enhancement: A New Dataset and A Conditional Diffusion Model

Learning Dual-Level Deformable Implicit Representation for Real-World Scale Arbitrary Super-Resolution

How Real is Real: Evaluating the Robustness of Real-World Super Resolution

UASSR: Unsupervised Arbitrary Scale Super-Resolution Reconstruction of Single Anisotropic 3D Images via Disentangled Representation Learning

Component Divide-and-Conquer for Real-World Image Super-Resolution