Abstract:Image super-resolution (SR) task aims to recover high-resolution (HR) images from degraded low-resolution (LR) images, which has achieved great progress due to the recent advances of deep neural networks. Due to severe information loss of the LR images, it is more challenging to reconstruct high quality HR images at large scale factors, i. e., higher than 4× . Traditional reference image based SR methods usually perform patch matching to locate detailed texture from HR reference images which could provide fine details from similar image contents. But it suffers from difficulties in achieving good matching in the largely downscaled image space or feature space due to the ill-posed nature between LR and HR mapping. In this paper, we tackle this problem by exploiting fine details contained in reference HR images. Inspired by vector quantization (VQ), we propose a simple yet effective auto-encoder convolutional neural network (CNN) module to learn discrete representations of images. Furthermore, we propose to progressively learn pairs of cross-scale discrete feature representations using paired LR and HR reference images. The coarser scale of the discrete representation is responsible for encoding the global image structure while the paired finer scale of the discrete representation takes charge of capturing missing details in the finer image scale. During inference, continuous features of the test LR image are used as queries to retrieve finer scale discrete representations (value) by searching the nearest coarser scale discrete representations (key). Then, the queries and retrieved values are combined to progressively recover the HR image. Experimental results indicate that when compared with the state-of-the-art image SR models, the proposed method can achieve advanced performance in terms of both objective quality and subjective quality. The code will be available on URL: https://github.com/sunwj/refsr.

Self-Reference Image Super-Resolution via Pre-trained Diffusion Large Model and Window Adjustable Transformer

SR-USRN: Learning Image Super-Resolution with Unified Structure and Reverse Network.

Reference-Based Image Super-Resolution with Deformable Attention Transformer.

Reference Guided Image Super-Resolution Via Efficient Dense Warping and Adaptive Fusion

Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionary

Effective Diffusion Transformer Architecture for Image Super-Resolution

Detail-Enhancing Framework for Reference-Based Image Super-Resolution

AddSR: Accelerating Diffusion-based Blind Super-Resolution with Adversarial Diffusion Distillation

Exploiting Diffusion Prior for Real-World Image Super-Resolution

Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning

Image Super-Resolution using Efficient Striped Window Transformer

DSMA: Reference-Based Image Super-Resolution Method Based on Dual-View Supervised Learning and Multi-Attention Mechanism

RRSR: Reciprocal Reference-based Image Super-Resolution with Progressive Feature Alignment and Selection.

Adaptive Multi-modal Fusion of Spatially Variant Kernel Refinement with Diffusion Model for Blind Image Super-Resolution

Enhanced Window-Based Self-Attention with Global and Multi-Scale Representations for Remote Sensing Image Super-Resolution

Task Decoupled Framework for Reference-based Super-Resolution

Learning Discrete Representations From Reference Images for Large Scale Factor Image Super-Resolution

Building Bridges across Spatial and Temporal Resolutions: Reference-Based Super-Resolution via Change Priors and Conditional Diffusion Model

SRFormerV2: Taking a Closer Look at Permuted Self-Attention for Image Super-Resolution

Double-Layer Search and Adaptive Pooling Fusion for Reference-Based Image Super-Resolution

Dense Contrastive Learning and Depth Dynamic Aggregation for Reference-based Super-Resolution.