Abstract:Recent advancements in diffusion models have significantly improved performance in super-resolution (SR) tasks. However, previous research often overlooks the fundamental differences between SR and general image generation. General image generation involves creating images from scratch, while SR focuses specifically on enhancing existing low-resolution (LR) images by adding typically missing high-frequency details. This oversight not only increases the training difficulty but also limits their inference efficiency. Furthermore, previous diffusion-based SR methods are typically trained and inferred at fixed integer scale factors, lacking flexibility to meet the needs of up-sampling with non-integer scale factors. To address these issues, this paper proposes an efficient and elastic diffusion-based SR model (E$^2$DiffSR), specially designed for continuous-scale SR in remote sensing imagery. E$^2$DiffSR employs a two-stage latent diffusion paradigm. During the first stage, an autoencoder is trained to capture the differential priors between high-resolution (HR) and LR images. The encoder intentionally ignores the existing LR content to alleviate the encoding burden, while the decoder introduces an SR branch equipped with a continuous scale upsampling module to accomplish the reconstruction under the guidance of the differential prior. In the second stage, a conditional diffusion model is learned within the latent space to predict the true differential prior encoding. Experimental results demonstrate that E$^2$DiffSR achieves superior objective metrics and visual quality compared to the state-of-the-art SR methods. Additionally, it reduces the inference time of diffusion-based SR methods to a level comparable to that of non-diffusion methods.

Continuous Remote Sensing Image Super-Resolution Based on Context Interaction in Implicit Function Space

Continuous Digital Zoom with Cross Attention for Dual Camera System

Face Super-Resolution Via Bilayer Contextual Representation

SR-FEINR: Continuous Remote Sensing Image Super-Resolution Using Feature-Enhanced Implicit Neural Representation

A New Super Resolution Framework Based on Multi-Task Learning for Remote Sensing Images

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Implicit Diffusion Models for Continuous Super-Resolution

Latent Diffusion, Implicit Amplification: Efficient Continuous-Scale Super-Resolution for Remote Sensing Images

Boosting Image Super-Resolution Via Fusion of Complementary Information Captured by Multi-Modal Sensors

Super-Resolution Neural Operator

UltraSR: Spatial Encoding is a Missing Key for Implicit Image Function-based Arbitrary-Scale Super-Resolution

SSIF: Learning Continuous Image Representation for Spatial-Spectral Super-Resolution

A Practical And Adaptive Framework For Super-Resolution

Exploiting Self-Supervised Constraints in Image Super-Resolution

Hyperspectral Image Joint Super-Resolution via Local Implicit Spatial-Spectral Function Learning

Enhanced Implicit Function-Based Network for Arbitrary-Scale Image Super-Resolution

A Conditional Diffusion Model With Fast Sampling Strategy for Remote Sensing Image Super-Resolution

Robust Remote Sensing Super-Resolution With Frequency Domain Decoupling for Multiscenarios

CoSeR: Bridging Image and Language for Cognitive Super-Resolution

FSR: A General Frequency-Oriented Framework to Accelerate Image Super-resolution Networks.

Adaptive Multi-modal Fusion of Spatially Variant Kernel Refinement with Diffusion Model for Blind Image Super-Resolution