Abstract:Recent research on deep convolutional neural networks (CNNs) has provided a significant performance boost on efficient super-resolution (SR) tasks by trading off the performance and applicability. However, most existing methods focus on subtracting feature processing consumption to reduce the parameters and calculations without refining the immediate features, which leads to inadequate information in the restoration. In this paper, we propose a lightweight network termed DDistill-SR, which significantly improves the SR quality by capturing and reusing more helpful information in a static-dynamic feature distillation manner. Specifically, we propose a plug-in reparameterized dynamic unit (RDU) to promote the performance and inference cost trade-off. During the training phase, the RDU learns to linearly combine multiple reparameterizable blocks by analyzing varied input statistics to enhance layer-level representation. In the inference phase, the RDU is equally converted to simple dynamic convolutions that explicitly capture robust dynamic and static feature maps. Then, the information distillation block is constructed by several RDUs to enforce hierarchical refinement and selective fusion of spatial context information. Furthermore, we propose a dynamic distillation fusion (DDF) module to enable dynamic signals aggregation and communication between hierarchical modules to further improve performance. Empirical results show that our DDistill-SR outperforms the baselines and achieves state-of-the-art results on most super-resolution domains with much fewer parameters and less computational overhead. We have released the code of DDistill-SR at <a class="link-external link-https" href="https://github.com/icandle/DDistill-SR" rel="external noopener nofollow">this https URL</a>.

Pairwise Distance Distillation for Unsupervised Real-World Image Super-Resolution

Learning the Degradation Distribution for Blind Image Super-Resolution

Distillation-Free One-Step Diffusion for Real-World Image Super-Resolution

AddSR: Accelerating Diffusion-based Blind Super-Resolution with Adversarial Diffusion Distillation

DeeDSR: Towards Real-World Image Super-Resolution via Degradation-Aware Stable Diffusion

Synthesizing Realistic Image Restoration Training Pairs: A Diffusion Approach

Real-World Image Super-Resolution by Exclusionary Dual-Learning

DDistill-SR: Reparameterized Dynamic Distillation Network for Lightweight Image Super-Resolution

Unsupervised Real-World Image Super-Resolution via Dual Synthetic-to-Realistic and Realistic-to-Synthetic Translations

Unsupervised Degradation Learning for Single Image Super-Resolution

DDNSR: a dual-input degradation network for real-world super-resolution

TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolution

One Step Diffusion-based Super-Resolution with Time-Aware Distillation

Learning Many-to-Many Mapping for Unpaired Real-World Image Super-resolution and Downscaling

Unsupervised image blind super resolution via real degradation feature learning

Unsupervised Real-world Image Super Resolution Via Domain-distance Aware Training

Toward Real World Stereo Image Super-Resolution via Hybrid Degradation Model and Discriminator for Implied Stereo Image Information

Unsupervised Learning for Real-World Super-Resolution

GDSSR: Toward Real-World Ultra-High-Resolution Image Super-Resolution

Real-World Super-Resolution Via Kernel Estimation and Noise Injection

From Face to Natural Image: Learning Real Degradation for Blind Image Super-Resolution