Abstract:Constrained by imaging systems, hyperspectral images (HSIs) always have a low spatial resolution. Deep learning-based HSI super-resolution methods have achieved impressive results through learning the nonlinear mapping between low-resolution (LR) and high-resolution (HR) images. However, most of them take the LR image or its upsampled version through bicubic interpolation as input, leading to low-quality features and limited details captured by the network. As a powerful generative model, diffusion model has the ability to learn both contextual semantics and textual details from distinct timesteps, enabling the effective exploration of spatial-spectral distributions in high-dimensional data. In this paper, we propose a novel method that extracts high-quality prior information from original images to assist in super-resolution through pretraining a diffusion model. Specifically, we first train a diffusion model using original HSI patches in a self-supervised manner and then obtain prior features from the pretrained denoising U-Net decoder. To efficiently incorporate the prior features into the super-resolution model, we propose an adaptive fusion module based on spatial and spectral attention mechanisms, which enhances features in both dimensions while preserving the original characteristics. Additionally, to leverage the complementarity of spatial and spectral information, we design a spatial-spectral aggregation Transformer module that incorporates an adaptive interaction module to facilitate information exchange across different dimensions, thereby enhancing the representation capability. Extensive experiments on three public hyperspectral datasets demonstrate that the proposed method achieves excellent super-resolution performance and outperforms the state-of-the-art methods in terms of quantitative quality and visual results.

RGB Images Enhancing Hyperspectral Image Denoising with Diffusion Model

A Noise-Model-Free Hyperspectral Image Denoising Method Based on Diffusion Model.

Learning a Model-Based Deep Hyperspectral Denoiser from a Single Noisy Hyperspectral Image.

R2H-CCD: Hyperspectral Imagery Generation from RGB Images Based on Conditional Cascade Diffusion Probabilistic Models

Stimulating Diffusion Model for Image Denoising via Adaptive Embedding and Ensembling

Stimulating the Diffusion Model for Image Denoising Via Adaptive Embedding and Ensembling

Robust Hyperspectral Unmixing with Practical Learning-Based Hyperspectral Image Denoising

HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models

HSR-Diff: Hyperspectral Image Super-Resolution Via Conditional Diffusion Models

Unmixing Diffusion for Self-Supervised Hyperspectral Image Denoising

DDRF: Denoising Diffusion Model for Remote Sensing Image Fusion

Hyperspectral and Multispectral Image Fusion Using the Conditional Denoising Diffusion Probabilistic Model

Hyperspectral Image Restoration Using Spatial-Spectral Diffusion Null-Space Model

HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models

Spatial-Spectral Aggregation Transformer with Diffusion Prior for Hyperspectral Image Super-Resolution

Diffusion model with disentangled modulations for sharpening multispectral and hyperspectral images

Image Denoising Via Multiscale Nonlinear Diffusion Models.

Enhancing Hyperspectral Images via Diffusion Model and Group-Autoencoder Super-resolution Network

Image Denoising via Multi-scale Nonlinear Diffusion Models

Directly Denoising Diffusion Models

TDiffDe: A Truncated Diffusion Model for Remote Sensing Hyperspectral Image Denoising