Abstract:Hyperspectral image (HSI) denoising is an ill-posed inverse problem. The underlying physical model is always important to tackle this problem, which is unfortunately ignored by most of the current deep learning (DL)-based methods, producing poor denoising performance. To address this issue, this article introduces an end-to-end model-aided nonlocal neural network (MAC-Net) which simultaneously takes the spectral low-rank model and spatial deep prior into account for HSI noise reduction. Specifically, motivated by the success of the spectral low-rank model in depicting the strong spectral correlations and the nonlocal similarity prior in capturing spatial long-range dependencies, we first build a spectral low-rank model and then integrate a nonlocal U-Net into the model. In this way, we obtain a hybrid model-based and DL-based HSI denoising method where the spatial local and nonlocal multi-scale and spectral low-rank structures are effectively exploited. After that, we cast the optimization and denoising procedure of the hybrid method as a forward process of a neural network and introduce a set of learnable modules to yield our MAC-Net. Compared with traditional model-based methods, our MAC-Net overcomes the difficulties of accurate modeling, thanks to the strong learning and representation ability of DL. Unlike most “black-box” DL-based methods, the spectral low-rank model is beneficial to increase the generalization ability of the network and decrease the requirement of training samples. Experimental results on the natural and remote-sensing HSIs show that MAC-Net achieves state-of-the-art performance over both model-based and DL-based methods. The source code and data of this article will be made publicly available at https://github.com/bearshng/mac-net for reproducible research.

Hypspectral Image Denoising Via Multidimensional Nonlocal Model

3-D nonlocal means filter with noise estimation for hyperspectral imagery denoising

Multitask Sparse Nonnegative Matrix Factorization for Joint Spectral–Spatial Hyperspectral Imagery Denoising

Nonlocal Spatial–Spectral Neural Network for Hyperspectral Image Denoising

Hyperspectral Image Denoising Via Combined Non-Local Self-Similarity and Local Low-Rank Regularization

Multitask Sparse Representation Model-Inspired Network for Hyperspectral Image Denoising

Hyperspectral Image Denoising with Weighted Nonlocal Low-Rank Model and Adaptive Total Variation Regularization.

Learning a Model-Based Deep Hyperspectral Denoiser from a Single Noisy Hyperspectral Image.

A Noise-Model-Free Hyperspectral Image Denoising Method Based on Diffusion Model.

Non-local Meets Global: An Integrated Paradigm for Hyperspectral Denoising

Group Sparse Nonnegative Matrix Factorization for Hyperspectral Image Denoising

MAC-Net: Model-Aided Nonlocal Neural Network for Hyperspectral Image Denoising.

Hyperspectral Image Denoising Via Double Subspace Deep Prior

Hyperspectral Image Mixed Noise Removal via Double Factor Total Variation Nonlocal Low-Rank Tensor Regularization

Hyperspectral Image Denoising Using Global Weighted Tensor Norm Minimum And Nonlocal Low-Rank Approximation

Hyperspectral image recovery employing a multidimensional nonlocal total variation model

Denoising Hyperspectral Image with Non-i.i.d. Noise Structure

Spectral-Spatial Joint Noise Estimation for Hyperspectral Images

Nonlocal Structured Sparsity Regularization Modeling for Hyperspectral Image Denoising.

Hyperspectral Image Denoising Via Spectral and Spatial Low-Rank Approximation

Hyperspectral Image Denoising by Pixel-Wise Noise Modeling and TV-Oriented Deep Image Prior