Abstract:Constrained by imaging systems, hyperspectral images (HSIs) always have a low spatial resolution. Deep learning-based HSI super-resolution methods have achieved impressive results through learning the nonlinear mapping between low-resolution (LR) and high-resolution (HR) images. However, most of them take the LR image or its upsampled version through bicubic interpolation as input, leading to low-quality features and limited details captured by the network. As a powerful generative model, diffusion model has the ability to learn both contextual semantics and textual details from distinct timesteps, enabling the effective exploration of spatial-spectral distributions in high-dimensional data. In this paper, we propose a novel method that extracts high-quality prior information from original images to assist in super-resolution through pretraining a diffusion model. Specifically, we first train a diffusion model using original HSI patches in a self-supervised manner and then obtain prior features from the pretrained denoising U-Net decoder. To efficiently incorporate the prior features into the super-resolution model, we propose an adaptive fusion module based on spatial and spectral attention mechanisms, which enhances features in both dimensions while preserving the original characteristics. Additionally, to leverage the complementarity of spatial and spectral information, we design a spatial-spectral aggregation Transformer module that incorporates an adaptive interaction module to facilitate information exchange across different dimensions, thereby enhancing the representation capability. Extensive experiments on three public hyperspectral datasets demonstrate that the proposed method achieves excellent super-resolution performance and outperforms the state-of-the-art methods in terms of quantitative quality and visual results.

Hyperspectral Image Restoration Using Spatial-Spectral Diffusion Null-Space Model

A Noise-Model-Free Hyperspectral Image Denoising Method Based on Diffusion Model.

HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models

RGB Images Enhancing Hyperspectral Image Denoising with Diffusion Model

DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restoration

A hyperspectral image denoising method based on land cover spectral autocorrelation

Hyperspectral Image Restoration with Self-Supervised Learning: A Two-Stage Training Approach

Unmixing Diffusion for Self-Supervised Hyperspectral Image Denoising

A Self-Supervised Hyperspectral Image Restoration Method Based on Convolutional Sparse Coding and Superpixel Segmentation

Diffusion Posterior Proximal Sampling for Image Restoration

Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model

A Spectral Diffusion Prior for Hyperspectral Image Super-Resolution

Latent Diffusion Enhanced Rectangle Transformer for Hyperspectral Image Restoration

Spatial-Spectral Aggregation Transformer with Diffusion Prior for Hyperspectral Image Super-Resolution

Hyperspectral Image Denoising Via Spectral and Spatial Low-Rank Approximation

Improving Diffusion-Based Image Restoration with Error Contraction and Error Correction

A Spectral Diffusion Prior for Unsupervised Hyperspectral Image Super-Resolution

Hyperspectral Image Restoration Combining Intrinsic Image Characterization With Robust Noise Modeling

Decoupled Data Consistency with Diffusion Purification for Image Restoration

Resfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noise