Abstract:Image super-resolution (SR) task aims to recover high-resolution (HR) images from degraded low-resolution (LR) images, which has achieved great progress due to the recent advances of deep neural networks. Due to severe information loss of the LR images, it is more challenging to reconstruct high quality HR images at large scale factors, i. e., higher than 4× . Traditional reference image based SR methods usually perform patch matching to locate detailed texture from HR reference images which could provide fine details from similar image contents. But it suffers from difficulties in achieving good matching in the largely downscaled image space or feature space due to the ill-posed nature between LR and HR mapping. In this paper, we tackle this problem by exploiting fine details contained in reference HR images. Inspired by vector quantization (VQ), we propose a simple yet effective auto-encoder convolutional neural network (CNN) module to learn discrete representations of images. Furthermore, we propose to progressively learn pairs of cross-scale discrete feature representations using paired LR and HR reference images. The coarser scale of the discrete representation is responsible for encoding the global image structure while the paired finer scale of the discrete representation takes charge of capturing missing details in the finer image scale. During inference, continuous features of the test LR image are used as queries to retrieve finer scale discrete representations (value) by searching the nearest coarser scale discrete representations (key). Then, the queries and retrieved values are combined to progressively recover the HR image. Experimental results indicate that when compared with the state-of-the-art image SR models, the proposed method can achieve advanced performance in terms of both objective quality and subjective quality. The code will be available on URL: https://github.com/sunwj/refsr.

Progressive Image Super-Resolution via Neural Differential Equation

A Single-Image Super-Resolution Method Based on Progressive-Iterative Approximation

Image supper resolution by dilated dense progressive network

Neural Differential Equations for Single Image Super-resolution

Progressive Face Super-Resolution via Attention to Facial Landmark

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Arbitrary-Scale Image Generation and Upsampling using Latent Diffusion Model and Implicit Neural Decoder

Fluid Micelle Network for Image Super-Resolution Reconstruction

P‐8.6: A Progressive Single Image Super‐Resolution Algorithm

Single-Image Super-Resolution Via an Iterative Reproducing Kernel Hilbert Space Method.

Super-Resolution Neural Operator

A practical super-resolution method for multi-degradation remote sensing images with deep convolutional neural networks

Single image super-resolution via deep progressive multi-scale fusion networks

Learning Discrete Representations From Reference Images for Large Scale Factor Image Super-Resolution

End-to-End Alternating Optimization for Real-World Blind Super Resolution

Super-Resolution for Noisy Images Via Deep Convolutional Neural Network

Single-Image Super-Resolution by Subdictionary Coding and Kernel Regression

Image Super-Resolution Using Deep Convolutional Networks

End-to-End Image Super-Resolution via Deep and Shallow Convolutional Networks

DDet: Dual-path Dynamic Enhancement Network for Real-World Image Super-Resolution

Super-Resolution Neural Radiance Field via Learning High Frequency Details for High-Fidelity Novel View Synthesis