Abstract:Recent advancements in diffusion models have significantly improved performance in super-resolution (SR) tasks. However, previous research often overlooks the fundamental differences between SR and general image generation. General image generation involves creating images from scratch, while SR focuses specifically on enhancing existing low-resolution (LR) images by adding typically missing high-frequency details. This oversight not only increases the training difficulty but also limits their inference efficiency. Furthermore, previous diffusion-based SR methods are typically trained and inferred at fixed integer scale factors, lacking flexibility to meet the needs of up-sampling with non-integer scale factors. To address these issues, this paper proposes an efficient and elastic diffusion-based SR model (E$^2$DiffSR), specially designed for continuous-scale SR in remote sensing imagery. E$^2$DiffSR employs a two-stage latent diffusion paradigm. During the first stage, an autoencoder is trained to capture the differential priors between high-resolution (HR) and LR images. The encoder intentionally ignores the existing LR content to alleviate the encoding burden, while the decoder introduces an SR branch equipped with a continuous scale upsampling module to accomplish the reconstruction under the guidance of the differential prior. In the second stage, a conditional diffusion model is learned within the latent space to predict the true differential prior encoding. Experimental results demonstrate that E$^2$DiffSR achieves superior objective metrics and visual quality compared to the state-of-the-art SR methods. Additionally, it reduces the inference time of diffusion-based SR methods to a level comparable to that of non-diffusion methods.

From Diffusion to Resolution: Leveraging 2D Diffusion Models for 3D Super-Resolution Task

Advance and Prospect for Three-Dimensional Super-Resolution Microscopy

Three-Dimensional Super-Resolution Imaging for Fluorescence Emission Difference Microscopy

3D resoution enhancement in saturated competition microscopy

Diffusion-based deep learning method for augmenting ultrastructural imaging and volume electron microscopy

Frequency-Domain Refinement with Multiscale Diffusion for Super Resolution

Super-resolution of biomedical volumes with 2D supervision

DiffuseIR:Diffusion Models For Isotropic Reconstruction of 3D Microscopic Images

DiffuseIR: Diffusion Models for Isotropic Reconstruction of 3D Microscopic Images

Latent Diffusion, Implicit Amplification: Efficient Continuous-Scale Super-Resolution for Remote Sensing Images

Enhancing Remote Sensing Image Super-Resolution with Efficient Hybrid Conditional Diffusion Model

Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models

Dual stage processed 3D network super resolution for volumetric fluorescence microscopy far beyond throughput limit

Super-resolved virtual staining of label-free tissue using diffusion models

Diffusion Model with Detail Complement for Super-Resolution of Remote Sensing

Rethinking Diffusion Model for Multi-Contrast MRI Super-Resolution

ResDiff: Combining CNN and Diffusion Model for Image Super-Resolution

Topology-Preserving Computed Tomography Super-Resolution Based on Dual-Stream Diffusion Model

SAM-DiffSR: Structure-Modulated Diffusion Model for Image Super-Resolution

ACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-Resolution