Abstract:Image super-resolution (SR) task aims to recover high-resolution (HR) images from degraded low-resolution (LR) images, which has achieved great progress due to the recent advances of deep neural networks. Due to severe information loss of the LR images, it is more challenging to reconstruct high quality HR images at large scale factors, i. e., higher than 4× . Traditional reference image based SR methods usually perform patch matching to locate detailed texture from HR reference images which could provide fine details from similar image contents. But it suffers from difficulties in achieving good matching in the largely downscaled image space or feature space due to the ill-posed nature between LR and HR mapping. In this paper, we tackle this problem by exploiting fine details contained in reference HR images. Inspired by vector quantization (VQ), we propose a simple yet effective auto-encoder convolutional neural network (CNN) module to learn discrete representations of images. Furthermore, we propose to progressively learn pairs of cross-scale discrete feature representations using paired LR and HR reference images. The coarser scale of the discrete representation is responsible for encoding the global image structure while the paired finer scale of the discrete representation takes charge of capturing missing details in the finer image scale. During inference, continuous features of the test LR image are used as queries to retrieve finer scale discrete representations (value) by searching the nearest coarser scale discrete representations (key). Then, the queries and retrieved values are combined to progressively recover the HR image. Experimental results indicate that when compared with the state-of-the-art image SR models, the proposed method can achieve advanced performance in terms of both objective quality and subjective quality. The code will be available on URL: https://github.com/sunwj/refsr.

Learning stacking regression for no-reference super-resolution image quality assessment

SPQE: Structure-and-Perception-Based Quality Evaluation for Image Super-Resolution

Deep Supervised Dictionary Learning for No-Reference Image Quality Assessment

Textural-Perceptual Joint Learning for No-Reference Super-Resolution Image Quality Assessment

A Deep Learning Based No-Reference Image Quality Assessment Model For Single-Image Super-Resolution

No-reference stereoscopic image quality assessment based on global and local content characteristics

Single image super-resolution via Image Quality Assessment-Guided Deep Learning Network

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Blind Quality Assessment for Image Superresolution Using Deep Two-Stream Convolutional Networks

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

Deep Objective Quality Assessment Driven Single Image Super-Resolution

Deep Bi-directional Attention Network for Image Super-Resolution Quality Assessment

Perception- and Fidelity-aware Reduced-Reference Super-Resolution Image Quality Assessment

Learning degradation priors for reliable no-reference image quality assessment

Non-Local Nested Residual Attention Network for Stereo Image Super-Resolution.

Two-channel Deep Recursive Multi-Scale Network Based on Multi-Attention for No-Reference Image Quality Assessment

ReLaX-VQA: Residual Fragment and Layer Stack Extraction for Enhancing Video Quality Assessment

No-reference Image Quality Assessment Via Non-local Dependency Modeling.

Learning Discrete Representations From Reference Images for Large Scale Factor Image Super-Resolution

Single Image Super-Resolution with Non-Local Means and Steering Kernel Regression