Abstract:Image denoising is often empowered by accurate prior information. In recent years, data-driven neural network priors have shown promising performance for RGB natural image denoising. Compared to classic handcrafted priors (e.g., sparsity and total variation), the "deep priors" are learned using a large number of training samples -- which can accurately model the complex image generating process. However, data-driven priors are hard to acquire for hyperspectral images (HSIs) due to the lack of training data. A remedy is to use the so-called unsupervised deep image prior (DIP). Under the unsupervised DIP framework, it is hypothesized and empirically demonstrated that proper neural network structures are reasonable priors of certain types of images, and the network weights can be learned without training data. Nonetheless, the most effective unsupervised DIP structures were proposed for natural images instead of HSIs. The performance of unsupervised DIP-based HSI denoising is limited by a couple of serious challenges, namely, network structure design and network complexity. This work puts forth an unsupervised DIP framework that is based on the classic spatio-spectral decomposition of HSIs. Utilizing the so-called linear mixture model of HSIs, two types of unsupervised DIPs, i.e., U-Net-like network and fully-connected networks, are employed to model the abundance maps and endmembers contained in the HSIs, respectively. This way, empirically validated unsupervised DIP structures for natural images can be easily incorporated for HSI denoising. Besides, the decomposition also substantially reduces network complexity. An efficient alternating optimization algorithm is proposed to handle the formulated denoising problem. Semi-real and real data experiments are employed to showcase the effectiveness of the proposed approach.

Self-Supervised Hyperspectral Inpainting with the Optimisation inspired Deep Neural Network Prior

Self-supervised Deep Hyperspectral Inpainting with the Sparsity and Low-Rank Considerations

A Self-Supervised Denoising Network for Satellite-Airborne-Ground Hyperspectral Imagery

Deep Low-Rank Prior for Hyperspectral Anomaly Detection

HSI-IPNet: Hyperspectral Imagery Inpainting by Deep Learning with Adaptive Spectral Extraction

Equivariant Imaging for Self-supervised Hyperspectral Image Inpainting

Self-Supervised Learning Hyperspectral Image Denoiser with Separated Spectral-Spatial Feature Extraction.

HSI-IPGAN: Hyperspectral Image Inpainting via Generative Adversarial Network

Deep Parameterized Neural Networks for Hyperspectral Image Denoising

Hyperspectral Image Restoration with Self-Supervised Learning: A Two-Stage Training Approach

Hyperspectral Denoising Using Unsupervised Disentangled Spatio-Spectral Deep Priors

Hyperspectral Denoising Using Unsupervised Disentangled Spatiospectral Deep Priors

Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representations

A Self-Supervised Hyperspectral Image Restoration Method Based on Convolutional Sparse Coding and Superpixel Segmentation

An Adaptive Iterative Inpainting Method with More Information Exploration

GLCSA-Net: Global–local Constraints-Based Spectral Adaptive Network for Hyperspectral Image Inpainting

Supervise-Assisted Self-Supervised Deep-Learning Method for Hyperspectral Image Restoration

Deep Hyperspectral Prior: Denoising, Inpainting, Super-Resolution

Hierarchical Superpixel Relation Graph Combined with Convolutional Sparse Coding for Self-Supervised Hyperspectral Image Denoising

High-Quality Self-Supervised Snapshot Hyperspectral Imaging.

Hyperspectral Mixed Noise Removal Via Spatial-Spectral Constrained Unsupervised Deep Image Prior