Abstract:Hyperspectral image (HSI) plays a vital role in various fields such as agriculture and environmental monitoring. However, due to the expensive acquisition cost, the number of hyperspectral images is limited, degenerating the performance of downstream tasks. Although some recent studies have attempted to employ diffusion models to synthesize HSIs, they still struggle with the scarcity of HSIs, affecting the reliability and diversity of the generated images. Some studies propose to incorporate multi-modal data to enhance spatial diversity, but the spectral fidelity cannot be ensured. In addition, existing HSI synthesis models are typically uncontrollable or only support single-condition control, limiting their ability to generate accurate and reliable HSIs. To alleviate these issues, we propose HSIGene, a novel HSI generation foundation model which is based on latent diffusion and supports multi-condition control, allowing for more precise and reliable HSI generation. To enhance the spatial diversity of the training data while preserving spectral fidelity, we propose a new data augmentation method based on spatial super-resolution, in which HSIs are upscaled first, and thus abundant training patches could be obtained by cropping the high-resolution HSIs. In addition, to improve the perceptual quality of the augmented data, we introduce a novel two-stage HSI super-resolution framework, which first applies RGB bands super-resolution and then utilizes our proposed Rectangular Guided Attention Network (RGAN) for guided HSI super-resolution. Experiments demonstrate that the proposed model is capable of generating a vast quantity of realistic HSIs for downstream tasks such as denoising and super-resolution. The code and models are available at <a class="link-external link-https" href="https://github.com/LiPang/HSIGene" rel="external noopener nofollow">this https URL</a>.

R2H-CCD: Hyperspectral Imagery Generation from RGB Images Based on Conditional Cascade Diffusion Probabilistic Models

RGB Images Enhancing Hyperspectral Image Denoising with Diffusion Model

HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models

A Noise-Model-Free Hyperspectral Image Denoising Method Based on Diffusion Model.

HSIGene: A Foundation Model For Hyperspectral Image Generation

Hyperspectral and Multispectral Image Fusion Using the Conditional Denoising Diffusion Probabilistic Model

Learning a Model-Based Deep Hyperspectral Denoiser from a Single Noisy Hyperspectral Image.

Enhancing Remote Sensing Image Super-Resolution with Efficient Hybrid Conditional Diffusion Model

Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution

Robust Hyperspectral Unmixing with Practical Learning-Based Hyperspectral Image Denoising

Hyperspectral Image Super-Resolution with a Mosaic RGB Image

Deep-learning-based hyperspectral imaging through a RGB camera

S2CycleDiff: Spatial-Spectral-Bilateral Cycle-Diffusion Framework for Hyperspectral Image Super-resolution

Cluster-based deep convolutional networks for spectral reconstruction from RGB images

Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution

Residual HSRCNN: Residual Hyper-Spectral Reconstruction CNN from an RGB Image

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

EigenSR: Eigenimage-Bridged Pre-Trained RGB Learners for Single Hyperspectral Image Super-Resolution

RAW2HSI: Learning-Based Hyperspectral Image Reconstruction from Low-Resolution Noisy Raw-RGB

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion