Abstract:Hyperspectral Image (HSI) classification is an important issue in remote sensing field with extensive applications in earth science. In recent years, a large number of deep learning-based HSI classification methods have been proposed. However, existing methods have limited ability to handle high-dimensional, highly redundant, and complex data, making it challenging to capture the spectral-spatial distributions of data and relationships between samples. To address this issue, we propose a generative framework for HSI classification with diffusion models (SpectralDiff) that effectively mines the distribution information of high-dimensional and highly redundant data by iteratively denoising and explicitly constructing the data generation process, thus better reflecting the relationships between samples. The framework consists of a spectral-spatial diffusion module, and an attention-based classification module. The spectral-spatial diffusion module adopts forward and reverse spectral-spatial diffusion processes to achieve adaptive construction of sample relationships without requiring prior knowledge of graphical structure or neighborhood information. It captures spectral-spatial distribution and contextual information of objects in HSI and mines unsupervised spectral-spatial diffusion features within the reverse diffusion process. Finally, these features are fed into the attention-based classification module for per-pixel classification. The diffusion features can facilitate cross-sample perception via reconstruction distribution, leading to improved classification performance. Experiments on three public HSI datasets demonstrate that the proposed method can achieve better performance than state-of-the-art methods. For the sake of reproducibility, the source code of SpectralDiff will be publicly available at <a class="link-external link-https" href="https://github.com/chenning0115/SpectralDiff" rel="external noopener nofollow">this https URL</a>.

DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restoration

A Noise-Model-Free Hyperspectral Image Denoising Method Based on Diffusion Model.

Hyperspectral Image Restoration Using Spatial-Spectral Diffusion Null-Space Model

A Self-Supervised Hyperspectral Image Restoration Method Based on Convolutional Sparse Coding and Superpixel Segmentation

HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models

RGB Images Enhancing Hyperspectral Image Denoising with Diffusion Model

Hyperspectral Image Restoration with Self-Supervised Learning: A Two-Stage Training Approach

Unmixing Diffusion for Self-Supervised Hyperspectral Image Denoising

Hyperspectral Image Denoising Via Double Subspace Deep Prior

Supervise-Assisted Self-Supervised Deep-Learning Method for Hyperspectral Image Restoration

A hyperspectral image denoising method based on land cover spectral autocorrelation

Multitask Sparse Representation Model-Inspired Network for Hyperspectral Image Denoising

Learning a Model-Based Deep Hyperspectral Denoiser from a Single Noisy Hyperspectral Image.

Self-Supervised Learning Hyperspectral Image Denoiser with Separated Spectral-Spatial Feature Extraction.

ISPDiff: Interpretable Scale-Propelled Diffusion Model for Hyperspectral Image Super-Resolution

Spectral-Cascaded Diffusion Model for Remote Sensing Image Spectral Super-Resolution

Residual Denoising Diffusion Models

SpectralDiff: A Generative Framework for Hyperspectral Image Classification with Diffusion Models

Latent Diffusion Enhanced Rectangle Transformer for Hyperspectral Image Restoration

Total Variation Regularized Low-Rank Model With Directional Information for Hyperspectral Image Restoration

Consistent Diffusion: Denoising Diffusion Model with Data-Consistent Training for Image Restoration