Abstract:Hyperspectral image (HSI) denoising is an ill-posed inverse problem. The underlying physical model is always important to tackle this problem, which is unfortunately ignored by most of the current deep learning (DL)-based methods, producing poor denoising performance. To address this issue, this article introduces an end-to-end model-aided nonlocal neural network (MAC-Net) which simultaneously takes the spectral low-rank model and spatial deep prior into account for HSI noise reduction. Specifically, motivated by the success of the spectral low-rank model in depicting the strong spectral correlations and the nonlocal similarity prior in capturing spatial long-range dependencies, we first build a spectral low-rank model and then integrate a nonlocal U-Net into the model. In this way, we obtain a hybrid model-based and DL-based HSI denoising method where the spatial local and nonlocal multi-scale and spectral low-rank structures are effectively exploited. After that, we cast the optimization and denoising procedure of the hybrid method as a forward process of a neural network and introduce a set of learnable modules to yield our MAC-Net. Compared with traditional model-based methods, our MAC-Net overcomes the difficulties of accurate modeling, thanks to the strong learning and representation ability of DL. Unlike most “black-box” DL-based methods, the spectral low-rank model is beneficial to increase the generalization ability of the network and decrease the requirement of training samples. Experimental results on the natural and remote-sensing HSIs show that MAC-Net achieves state-of-the-art performance over both model-based and DL-based methods. The source code and data of this article will be made publicly available at https://github.com/bearshng/mac-net for reproducible research.

Eigen-CNN: Eigenimages Plus Eigennoise Level Maps Guided Network for Hyperspectral Image Denoising

A Self-Supervised Denoising Network for Satellite-Airborne-Ground Hyperspectral Imagery

Nonlocal Spatial–Spectral Neural Network for Hyperspectral Image Denoising

Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Network

Hyperspectral Image Denoising via Low-Rank Representation and CNN Denoiser

HSI-DeNet: Hyperspectral Image Restoration via Convolutional Neural Network

Self-Supervised Learning Hyperspectral Image Denoiser with Separated Spectral-Spatial Feature Extraction.

Hybrid Spatial-spectral Neural Network for Hyperspectral Image Denoising

A hyperspectral image denoising method based on land cover spectral autocorrelation

Deep Parameterized Neural Networks for Hyperspectral Image Denoising

Hyperspectral Image Restoration with Self-Supervised Learning: A Two-Stage Training Approach

Hyperspectral Image Denoising Via Nonnegative Matrix Factorization and Convolutional Neural Networks.

MAC-Net: Model-Aided Nonlocal Neural Network for Hyperspectral Image Denoising.

Learning a Model-Based Deep Hyperspectral Denoiser from a Single Noisy Hyperspectral Image.

NIEG-PNet: noise intensity estimation guided progressive network for hyperspectral image denoising

Robust Hyperspectral Unmixing with Practical Learning-Based Hyperspectral Image Denoising

Spatial-spectral convolutional sparse neural network for hyperspectral image denoising

Hierarchical Superpixel Relation Graph Combined with Convolutional Sparse Coding for Self-Supervised Hyperspectral Image Denoising

Multitask Sparse Representation Model-Inspired Network for Hyperspectral Image Denoising

Hyperspectral Image Denoising Via Matrix Factorization and Deep Prior Regularization

A Self-Supervised Hyperspectral Image Restoration Method Based on Convolutional Sparse Coding and Superpixel Segmentation