Abstract:Hyperspectral image (HSI) restoration is a challenging research area, covering a variety of inverse problems. Previous works have shown the great success of deep learning in HSI restoration. However, facing the problem of distribution gaps between training HSIs and target HSI, those data-driven methods falter in delivering satisfactory outcomes for the target HSIs. In addition, the degradation process of HSIs is usually disturbed by noise, which is not well taken into account in existing restoration methods. The existence of noise further exacerbates the dissimilarities within the data, rendering it challenging to attain desirable results without an appropriate learning approach. To track these issues, in this article, we propose a supervise-assisted self-supervised deep-learning method to restore noisy degraded HSIs. Initially, we facilitate the restoration network to acquire a generalized prior through supervised learning from extensive training datasets. Then, the self-supervised learning stage is employed and utilizes the specific prior of the target HSI. Particularly, to restore clean HSIs during the self-supervised learning stage from noisy degraded HSIs, we introduce a noise-adaptive loss function that leverages inner statistics of noisy degraded HSIs for restoration. The proposed noise-adaptive loss consists of Stein's unbiased risk estimator (SURE) and total variation (TV) regularizer and fine-tunes the network with the presence of noise. We demonstrate through experiments on different HSI tasks, including denoising, compressive sensing, super-resolution, and inpainting, that our method outperforms state-of-the-art methods on benchmarks under quantitative metrics and visual quality. The code is available at https://github.com/ying-fu/SSDL-HSI.

Hyperspectral image restoration via superpixel segmentation of smooth band

Hyperspectral image restoration based on color superpixel segmentation

Hyperspectral Image Denoising Via Minimizing the Partial Sum of Singular Values and Superpixel Segmentation

A Self-Supervised Hyperspectral Image Restoration Method Based on Convolutional Sparse Coding and Superpixel Segmentation

A hyperspectral image denoising method based on land cover spectral autocorrelation

Large-Scale Hyperspectral Image Restoration via a Superpixel Distributed Algorithm Based on Graph Signal Processing

Spectral-Spatial Joint Noise Estimation for Hyperspectral Images

Hyperspectral Restoration Via $L_0$ Gradient Regularized Low-Rank Tensor Factorization

Total Variation Regularized Low-Rank Model With Directional Information for Hyperspectral Image Restoration

Hyperspectral Image Restoration via Total Variation Regularized Low-rank Tensor Decomposition

Hyperspectral Image Restoration Combining Intrinsic Image Characterization With Robust Noise Modeling

Hyperspectral Imagery Restoration Based on Low-Rank Representation

Hyperspectral Image Restoration with Self-Supervised Learning: A Two-Stage Training Approach

Hyperspectral Image Denoising with Partially Orthogonal Matrix Vector Tensor Factorization

Hyperspectral Image Restoration Using Weighted Group Sparsity-Regularized Low-Rank Tensor Decomposition

Hyperspectral Image Restoration via Subspace-Based Nonlocal Low-Rank Tensor Approximation

Supervise-Assisted Self-Supervised Deep-Learning Method for Hyperspectral Image Restoration

Hyperspectral Image Denoising Using Nonconvex Fraction Function.

Multi-Scale Superpixels Dimension Reduction Hyperspectral Image Classification Algorithm Based on Low Rank Sparse Representation Joint Hierarchical Recursive Filtering

Hyperspectral Image Restoration Guided by Joint Statistical Characterization of Noise

Visualization of Hyperspectral Images Using Moving Least Squares