Abstract:Hyperspectral image (HSI) super-resolution (SR) employing the denoising diffusion probabilistic model (DDPM) holds significant promise with its remarkable performance. However, existing relevant works exhibit two limitations: 1) directly applying DDPM to fusion-based HSI-SR ignores the physical mechanism of HSI-SR and unique characteristics of HSI, resulting in less interpretability and 2) scale-invariant DDPM suffers from a time-consuming inference. To tackle these issues, we propose an interpretable scale-propelled diffusion (ISPDiff) model for HSI-SR, which combines the underlying principles of HSI-SR with DDPM for progressively unrolling reconstruction by learning its distribution at various scales, enhancing the transparency significantly and reducing the inference time prominently. Concretely, we destroy and downsample HSI into Gaussian noise in the forward process of ISPDiff. Then we design a unified scale-flexible model in the backward process to iteratively refine HSI in a coarse-to-fine manner through scale-matched reconstruction and cross-scale upsampling, which can be unfolded with optimization algorithms. These solved equations are one-to-one corresponding unrolled into two deep neural networks, called progressive perceptual model-driven scale-matched restoration network (P2MSRN) and cross-scale model-driven upsampling network (CMUN). Through end-to-end training, the proposed ISPDiff implements HSI-SR with a scale-propelled unrolling diffusion characterized by enhanced interpretability, stronger task orientation, and reduced time consumption. Systematic experiments have been conducted on three public datasets, demonstrating that ISPDiff outperforms state-of-the-art methods. The code is available at https://github.com/Jiahuiqu/ISPDiff.

CFMDM: Coarse-to-Fine Meta-Diffusion Model for Scale-Arbitrary Hyperspectral Super-Resolution

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

A Diffusion Model-Assisted Multiscale Spectral Attention Network for Hyperspectral Image Super-Resolution

HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models

Enhancing Remote Sensing Image Super-Resolution with Efficient Hybrid Conditional Diffusion Model

Meta-SR: A Magnification-Arbitrary Network for Super-Resolution

S2CycleDiff: Spatial-Spectral-Bilateral Cycle-Diffusion Framework for Hyperspectral Image Super-resolution

General Hyperspectral Image Super-Resolution via Meta-Transfer Learning

Spatial-Spectral Structured Sparse Low-Rank Representation for Hyperspectral Image Super-Resolution

Diffusion Model with Detail Complement for Super-Resolution of Remote Sensing

ISPDiff: Interpretable Scale-Propelled Diffusion Model for Hyperspectral Image Super-Resolution

Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

Frequency-Domain Refinement with Multiscale Diffusion for Super Resolution

Hyperspectral Image Super-Resolution with a Mosaic RGB Image

Model-Guided Deep Hyperspectral Image Super-Resolution

Dynamical Fusion Model With Joint Variational and Deep Priors for Hyperspectral Image Super-Resolution

Optimization-Based Hyperspectral Spatiotemporal Super-Resolution

ACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-Resolution

Meta-USR: A Unified Super-Resolution Network for Multiple Degradation Parameters